Zoox

Machine Learning Engineer - Vision Foundation Models

Zoox
Apply
1 day ago
Boston, MA, USA +3 moreSenior
H1B sponsor

Base Salary

$254k - $305k/yr

Responsibilities

  • Design, train, and evaluate vision models for passenger, object, and behavior understanding, including detection, pose, and action recognition.
  • Own model or feature areas end to end, including data curation, labeling guidelines, training, evaluation, and deployment.
  • Define model quality standards through rigorous evaluation and error analysis for live operations.
  • Deploy models under real-time and compute constraints within the onboard perception system.
  • Partner with product, operations, safety, and vehicle software teams to define model specifications, metrics, and validation plans.

Requirements

  • Master’s or PhD in Computer Science, Machine Learning, Computer Vision, or a related field, with 6+ years of industry experience; PhD candidates may qualify with 3+ years.
  • Deep expertise in computer vision and deep learning for image and video understanding, including object detection, pose recognition, action recognition, and fine-grained classification.
  • Hands-on experience with convolutional and vision-transformer detectors and self-supervised or foundation-model backbones such as DINOv3.
  • Strong proficiency in Python and PyTorch for model design, training, and evaluation.
  • Experience with vision-language models or foundation-model backbones and auto-labeling or synthetic data for long-tail and rare classes.
  • Track record owning the full machine learning lifecycle on real-world data, including dataset curation, labeling guidelines, metric design, and error analysis.
  • Experience with in-cabin or occupant monitoring, multi-camera or fisheye imagery, and low-light conditions is preferred.
  • Experience deploying deep learning models to real-time, resource-constrained systems using TensorRT, ONNX, or similar tools is preferred.
  • Proficiency in C++ for model integration is preferred.

Categories

Zoox

About Zoox

1,001-5,000 employees

Zoox builds a fully autonomous, purpose-built electric vehicle and the end-to-end platform to operate it as an urban robotaxi service. The company designs the vehicle, self-driving software, and fleet operations in-house to offer mobility-as-a-service rather than selling cars. Founded in 2014 and headquartered in Foster City, California, Zoox is a subsidiary of Amazon.

Contact me