4 months ago
Sunnyvale, CA, USASenior
Base Salary
$133k - $254k/yr
Responsibilities
- Set technical strategy and oversee development of a scalable, reliable data platform for large-scale ML datasets.
- Build a data lakehouse for autonomous-driving scene, sensor, calibration, and annotation data.
- Develop the Autonomous Driving Data SDK for scene search, dataset preparation, and dataset loading.
- Identify and resolve performance bottlenecks across data-processing and data-search pipelines.
- Maintain infrastructure for data-processing pipelines, databases, data lakehouses, and data-serving systems.
- Collaborate with ML algorithm, ML application, and cloud infrastructure teams on autonomous-driving architecture.
- Lead technical projects and align platform development with the ML model lifecycle.
Requirements
- Bachelor's degree or higher in Computer Science, Engineering, Robotics, or a similar technical field.
- Minimum of 7 years of experience in Data Engineering or ML Platform roles.
- Expert proficiency in Python and solid experience developing Python SDKs.
- Working experience with databases such as MongoDB and PostgreSQL.
- Strong understanding of AI frameworks such as PyTorch and TensorFlow, including distributed data loaders for model training.
- Hands-on experience orchestrating data-pipeline jobs with Databricks Workflows or Apache Airflow and integrating pipelines with machine-learning models.
- Extensive experience with data warehouse or lakehouse technologies such as Hive and Delta Lake.
- Experience with Apache Spark or other big-data computing engines.
- Leadership and communication skills with the ability to lead technical projects.
- Preferred: experience with autonomous-vehicle sensor data such as LiDAR, camera, or radar.
- Preferred: experience with ML model training, validation, deployment, data governance, privacy regulations, and data security measures.
- Preferred: understanding of large models such as VLM.
Benefits
- Base compensation is listed as $133,000-$254,0000.
- The interview process includes application review, coding test, two interviews, offer negotiation, and hiring.
- Applications must be submitted as PDF documents under 30MB; resume-upload issues can be handled by emailing recruit@42dot.ai.
- The employer encourages applications from U.S. veterans and candidates eligible for applicable employment preferences.
- Qualified individuals with disabilities will receive consideration under the ADA.
Tech Stack
Categories
