3 days ago
Base Salary
$185k - $242k/yr
Responsibilities
- Own safety and behavior metrics, including collision, near-miss, trajectory-agreement, and comfort measures, along with release go/no-go criteria.
- Build and operate log-replay and scoring pipelines for open-loop and closed-loop evaluation against ground truth.
- Own regression benchmarking across recorded-log corpora, including dataset design, regression detection, and case triage.
- Develop corpus-mining and sampling strategies for rare events, scenario coverage, and expected value per replay-hour.
- Ensure deterministic, reproducible evaluation execution with software-version traceability and replay-cost tracking.
- Set technical practices for metric definitions, test design, code review, and evaluation-result reporting.
- Mentor engineers, establish technical standards, and participate in hiring.
Requirements
- Bachelor’s degree in Computer Science, Robotics, Electrical Engineering, Statistics, or a related field.
- 8+ years of relevant experience.
- 2+ years as a technical lead or engineering manager for an evaluation, validation, or test team.
- Experience owning an offline or system-level evaluation system for an autonomous vehicle, robotics program, or comparable large-scale ML model evaluation system in production.
- Experience designing and defending safety or behavior metrics for autonomous systems.
- Hands-on experience building log replay at scale with open-loop and closed-loop scoring against ground truth.
- Experience running recurring evaluation pipelines on GPU clusters or comparable large-scale compute with responsibility for reproducibility, throughput, and cost.
- Experience with evaluation dataset design, benchmarking, and regression detection across software or model versions.
- Working knowledge of applied statistics for system validation, including uncertainty, sampling, rare-event analysis, and required data volume.
- Understanding of autonomous systems end to end, including sensing, perception, localization, planning, and controls.
- Experience on an autonomous vehicle or robotics platform.
- Experience with robotics middleware and logging and replay tooling.
- Experience handling multimodal autonomous-driving or robotics sensor data across camera, LiDAR, radar, and multiple timestamps.
- Proficiency in Python and ability to read, navigate, and debug existing C++ codebases.
Benefits
- Medical, dental, vision, disability, and life insurance.
- Flexible Spending Account and Health Savings Account options.
- 401(k), equity eligibility, sick time, unlimited flexible time off, and paid holidays.
- Paid parental leave and pre-tax commuter benefits.
- Team lunch in the SoMa office every Tuesday and Thursday.
- Based in San Francisco and onsite five days per week.
About Atoms
Atoms develops robotics, software, and infrastructure to automate real-world industrial operations, with offerings focused on food production, mining, and robotic transport platforms. It sells integrated automation systems and platforms—Atoms Food, Atoms Mining, and a transport wheelbase for robots—to industrial customers seeking greater productivity and scalability. The privately held company is headquartered in Los Angeles.