Machine Learning Engineer II - Autonomous Driving Performance Evaluation
May Mobility3 months ago
Remote, United StatesMid Level
H1B sponsor
Base Salary
$172k - $210k/yr
Responsibilities
- Design, implement, and own ML metrics and evaluation pipelines spanning offline model evaluation, simulation, and on-road performance.
- Build and maintain test, regression, and hillclimbing suites that gate model and autonomous-driving stack releases.
- Automate regression triage and identify root causes.
- Drive model improvement through loss analysis, error mining, and data balancing and curation strategies for training and evaluation sets.
- Design quantitative metrics and statistical analyses, including significance testing, slicing, and long-tail analysis.
- Build production evaluation and analytics frameworks with dataset slicing, result aggregation, and large-scale dashboarding.
- Apply data-centric ML methods such as hard-example mining, resampling, reweighting, and curriculum or balance adjustments.
Requirements
- Bachelor’s or master’s degree in robotics, computer science, statistics, or a related field with strong mathematical and engineering foundations, or comparable knowledge or experience.
- At least two years of experience building production ML evaluation, metrics, or data-analysis systems.
- Proficiency in Python with NumPy, Pandas, or equivalent dataframe tooling, and experience in Linux environments.
- Familiarity with machine-learning concepts including losses, train/evaluation splits, and common failure modes.
- Familiarity with basic perception and planning concepts in autonomous driving.
- Proficiency in Go or C++ is desirable.
- Experience with MLflow, Weights & Biases, or equivalent experiment-tracking and evaluation tooling is desirable.
- Familiarity with statistical methods for A/B comparison, regression detection, and noisy-metric analysis is desirable.
- Familiarity with large-scale data mining and curation, including embedding-based retrieval, active learning, or auto-labeling, is desirable.
- Familiarity with Plotly, Grafana, Streamlit, or similar visualization and dashboarding tools is desirable.
Benefits
- Comprehensive medical, dental, vision, life, and disability healthcare plans, with domestic partner eligibility after one year of co-residence.
- Health Savings and Flexible Spending Accounts for healthcare and dependent care.
- Immediately vested employer safe harbor retirement match.
- Paid parental leave with phased return to work.
- Flexible vacation policy and paid company holidays.
- Total Wellness Program resources.
- Standard office working conditions with 5–10% travel required.
Categories
ML EngineeringRobotics
About May Mobility
May Mobility builds autonomous vehicle technology that reasons through the world in real time. Our vehicles have delivered more than half a million rides across 24 deployments in the U.S. and Japan, including driverless operations in three states. We are partnering with Uber, Lyft, and Grab to bring autonomous ride-hail to communities everywhere.