DiDi

Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization

DiDi
Apply
10 hours ago
San Jose, CA, USASenior / Staff+
H1B sponsor

Base Salary

$170k - $351k/yr

Responsibilities

  • Own deployment, optimization, and resource scheduling of vehicle-side AI models for efficient, low-latency, robust execution within embedded constraints.
  • Lead vehicle-side system stability initiatives, including root-cause analysis and resolution of complex performance bottlenecks and runtime anomalies.
  • Architect and scale service-oriented deployment environments for LLMs and foundational models supporting offline simulation, automated annotation, and model validation.
  • Evaluate and integrate optimization toolchains, quantization techniques, and execution engines.
  • Establish profiling and telemetry frameworks using CUDA tools to maximize hardware utilization across GPU architectures.
  • Collaborate with Autonomous Driving Perception/Prediction, Cloud Infrastructure, and Safety teams on algorithm iteration and vehicle deployment.

Requirements

  • Master’s or higher degree in Computer Science, Software Engineering, Systems Engineering, or a closely related technical field.
  • 3–8+ years of industry experience in high-performance computing, AI infrastructure, model optimization, or embedded deployment.
  • Strong proficiency in C++ and Python, with expertise in parallel programming using CUDA and OpenMP and low-level system profiling tools.
  • Deep familiarity with TensorRT, ONNX Runtime, vLLM, SGLang, and TensorRT-LLM.
  • Understanding of GPU architectures such as NVIDIA Hopper and Thor and memory bandwidth management.
  • Ability to diagnose complex software-hardware integration issues and deliver scalable, production-grade solutions.
  • Preferred: experience optimizing and deploying models on NVIDIA Thor, serving foundation models with vLLM, SGLang, TGI, or LightLLM, using PyTorch, applying quantization, kernel fusion, or graph compilation, and deploying real-time AI workloads in autonomous vehicles, robotics, or edge devices.

Benefits

  • Full-time position with bonus, equity, and benefits.
  • Base salary range of $169,783–$351,000 annually, excluding bonus, equity, and benefits.
DiDi

About DiDi

10,000+ employees

DiDi is a mobility technology platform offering app-based ride hailing, taxi hailing, shared mobility, food delivery, and intra-city freight to consumers and businesses across Asia Pacific, Latin America, and other markets. It connects riders with drivers and couriers and provides vehicle, energy, and insurance-related services, earning transaction commissions and service fees. DiDi launched an autonomous driving unit in 2016, which became the independent DiDi Autonomous Driving in 2019 to develop Level 4 technology for its network.

Contact me