Zoox

Senior Staff/Principal Software Engineer - GPU System Software, Onboard Execution

Zoox
Apply
3 days ago
Boston, MA, USA +2 moreStaff+
H1B sponsor

Base Salary

$339k - $455k/yr

Responsibilities

  • Architect onboard GPU execution for perception, prediction, and planning workloads, including scheduling, multi-tenancy, isolation, and deterministic latency.
  • Own the multi-year roadmap for reducing onboard compute per vehicle through latency and utilization budgets and optimization across models, runtimes, middleware, and hardware.
  • Guide GPU and SoC selection, compute topology, memory budgets, workload modeling, and next-generation platform bring-up.
  • Set direction for inference performance using TensorRT, CUDA, custom kernels, quantization, and collaboration with ML teams.
  • Lead and mentor senior engineers, align directors and VPs through design documentation, and resolve performance, safety, and schedule tradeoffs.

Requirements

  • Bachelor’s degree in computer science, computer engineering, or a related field.
  • 10+ years of systems or performance engineering experience, including leading GPU or accelerator architecture across teams or building and leading a performance engineering team.
  • Deep expertise in the CUDA programming model, runtime, and driver, as well as NVIDIA GPU microarchitecture from Ampere through Blackwell, including Orin and Thor.
  • Proven record of setting technical direction and delivering measurable end-to-end improvements in latency, utilization, or cost.
  • Working knowledge of ML inference optimization, including TensorRT, XLA, Triton, quantization, and fusion.
  • Expert C++ development on Linux.
  • Bonus experience with real-time or embedded GPU systems, production GPU multi-tenancy, GPU platform bring-up, benchmarking methodology, or workload modeling and projections.

Tech Stack

Categories

Zoox

About Zoox

1,001-5,000 employees

Zoox builds a fully autonomous, purpose-built electric vehicle and the end-to-end platform to operate it as an urban robotaxi service. The company designs the vehicle, self-driving software, and fleet operations in-house to offer mobility-as-a-service rather than selling cars. Founded in 2014 and headquartered in Foster City, California, Zoox is a subsidiary of Amazon.

Contact me