Machine Learning Engineer II - Autonomous Driving Performance Evaluation
May Mobility5 months ago
Remote, United StatesMid Level
H1B sponsor
Base Salary
$172k - $210k/yr
Responsibilities
- Design, implement, and own ML metrics and evaluation pipelines spanning offline model evaluation, simulation, and on-road performance.
- Build and maintain test, regression, and hillclimbing suites that gate model and autonomous-driving stack releases.
- Automate regression triage and identify root causes.
- Drive model improvement through loss analysis, error mining, and data balancing and curation strategies for training and evaluation sets.
- Design quantitative metrics and statistical analyses, including significance testing, slicing, and long-tail analysis.
- Build production evaluation and analytics frameworks with dataset slicing, result aggregation, and large-scale dashboarding.
- Apply data-centric ML methods such as hard-example mining, resampling, reweighting, and curriculum or balance adjustments.
Requirements
- Bachelor’s or master’s degree in robotics, computer science, statistics, or a related field with strong mathematical and engineering foundations, or comparable knowledge or experience.
- At least two years of experience building production ML evaluation, metrics, or data-analysis systems.
- Proficiency in Python with NumPy, Pandas, or equivalent dataframe tooling, and experience in Linux environments.
- Familiarity with machine-learning concepts including losses, train/evaluation splits, and common failure modes.
- Familiarity with basic perception and planning concepts in autonomous driving.
- Proficiency in Go or C++ is desirable.
- Experience with MLflow, Weights & Biases, or equivalent experiment-tracking and evaluation tooling is desirable.
- Familiarity with statistical methods for A/B comparison, regression detection, and noisy-metric analysis is desirable.
- Familiarity with large-scale data mining and curation, including embedding-based retrieval, active learning, or auto-labeling, is desirable.
- Familiarity with Plotly, Grafana, Streamlit, or similar visualization and dashboarding tools is desirable.
Benefits
- Comprehensive medical, dental, vision, life, and disability healthcare plans, with domestic partner eligibility after one year of co-residence.
- Health Savings and Flexible Spending Accounts for healthcare and dependent care.
- Immediately vested employer safe harbor retirement match.
- Paid parental leave with phased return to work.
- Flexible vacation policy and paid company holidays.
- Total Wellness Program resources.
- Standard office working conditions with 5–10% travel required.
Categories
ML EngineeringRobotics
About May Mobility
May Mobility builds and operates autonomous vehicle technology for shared transit and ride-hail services. The company runs autonomous shuttles and driverless pilots with partners like Uber, Lyft, and Grab across deployments in the U.S. and Japan. Founded in 2017 and headquartered in Ann Arbor, Michigan, it sells autonomy-powered transportation services to cities and communities, having completed over 500,000 rides.