10 days ago
Base Salary
$320k - $489k/yr
Responsibilities
- Architect high-throughput, low-latency distributed inference pipelines for massive-scale AI workloads.
- Define and drive the technical roadmap for model deployment, versioning, automated scaling, orchestration, and full-lifecycle model management.
- Optimize GPU resources, hardware acceleration, kernels, drivers, and production model-serving performance.
- Guide and influence NVIDIA open-source and ecosystem projects, including Dynamo, TensorRT-LLM, vLLM, SGLang, Linux, Kubernetes, and Ray.
- Lead technical planning and continuous evolution across ideation, architecture, design, development, deployment, operations, and lifecycle management.
- Develop organizational alignment with engineering and senior corporate leadership and collaborate with customers, infrastructure providers, and partners.
Requirements
- 16+ years in technical roles, including a recent long-term focus on AI infrastructure and direct experience with large-scale inference orchestration.
- 7–10+ years of leadership experience.
- BS/MS or higher or equivalent experience in systems engineering, software engineering, or a related engineering field.
- Deep expertise in GPU architecture, hardware acceleration, CUDA, kernels, and cloud-native multi-tenant model serving.
- Proven experience building secure, highly available, durable distributed systems and delivering technically complex production solutions.
- Experience providing transparency into resource utilization, performance, and operational insights.
- Strong technical leadership, consensus-building, cross-functional alignment, communication, collaboration, and stakeholder influence skills.
- Experience building systems for AI/ML workloads and designing, delivering, and operating secure scaled-out systems in enterprise and cloud environments.
- Familiarity with open-source ecosystems and project governance, including Dynamo, TensorRT-LLM, vLLM, SGLang, and Ray.
Benefits
- Competitive salary, equity, and benefits package.
- The expected base salary range is USD 320,000–488,750, determined by location, experience, and other objective job-related factors.
- Applications are accepted at least until November 3, 2026.
- This posting is for an existing vacancy.
Tech Stack
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.