4 months ago
Sŏngnam, Korea, SouthSenior
Responsibilities
- Set technical strategy and oversee development of a scalable, reliable data platform for large-scale ML datasets.
- Build a data lakehouse for autonomous-driving scene, sensor, calibration, and annotation data.
- Develop the Autonomous Driving Data SDK for scene-data search, dataset preparation, and dataset loading.
- Identify and resolve performance bottlenecks across data-processing and data-search pipelines.
- Bootstrap and maintain infrastructure for data processing, databases, data lakehouses, and data serving.
- Collaborate with ML algorithm, ML application, and cloud infrastructure teams on platform architecture.
- Lead technical projects and align platform development with the broader autonomous-driving system architecture.
Requirements
- Bachelor’s degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
- At least 7 years of experience in Data Engineering or ML Platform roles.
- Expert-level Python proficiency and strong experience developing Python SDKs.
- Experience with databases such as MongoDB and PostgreSQL.
- Strong understanding of modern AI frameworks such as PyTorch and TensorFlow, including distributed data loaders for model training.
- Hands-on experience orchestrating data-pipeline jobs with Databricks Workflows or Apache Airflow and integrating pipelines with ML models.
- Extensive experience with data technologies and architectures including data warehouses such as Hive and lakehouses such as Delta Lake.
- Experience with Apache Spark or other big-data computing engines.
- Excellent leadership and communication skills with demonstrated ability to lead technical projects.
- Preferred experience with autonomous-vehicle sensor data such as LiDAR, camera, or radar.
- Preferred experience with ML model training lifecycles, data governance, data privacy regulations, security measures, and large models such as VLM.
Benefits
- A 3-month probationary period may apply.
- The interview process includes application screening, a coding test, virtual and/or in-person interviews, and offer discussion/onboarding.
Tech Stack
Categories
Data EngineeringML Engineering
About 42dot
42dot builds software-defined vehicle and autonomous mobility platforms for automakers and mobility service providers. Its products include AI-driven vehicle software, data-based update services, and core platform components such as API gateways and identity/access management to connect services securely. The privately held company is headquartered in Seongnam-si, Gyeonggi-do, and focuses on transportation and automotive markets.