10 days ago
Base Salary
$152k - $288k/yr
Responsibilities
- Design and implement end-to-end Grove integrations with Dynamo, llm-d, Ray, PyTorch, and related open-source AI frameworks.
- Build and maintain adapters, plugins, operators, runtime components, reference workflows, sample applications, and developer tooling.
- Collaborate with framework owners and open-source communities to upstream changes, contribute patches, and maintain integrations.
- Optimize distributed training and inference across multi-node and multi-GPU environments for performance, scalability, and reliability.
- Improve metrics, logging, tracing, debugging tools, and operational readiness for Kubernetes deployments.
- Define APIs and compatibility contracts and diagnose issues involving containers, networking, scheduling, CUDA/GPU utilization, and framework runtimes.
Requirements
- BS, MS, or PhD in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
- 5+ years of experience in a related field.
- Hands-on experience integrating with a major AI framework or runtime such as PyTorch, Ray, Triton Inference Server, distributed runtimes, or model-serving stacks.
- Understanding of AI workloads, including model development basics, training versus inference tradeoffs, throughput, latency, batching, and memory.
- Experience with distributed systems concepts including RPC, scheduling, fault tolerance, and resource management.
- Practical Kubernetes experience deploying and operating services and jobs, with Helm/Kustomize and cluster debugging; operators/controllers are a plus.
- Familiarity with containers, container registries, and cloud-native tooling.
- Strong software engineering experience in Go, C++, and/or Python with a history of shipping reliable systems.
- Open-source contributions, large-scale model serving, distributed inference, multi-tenant AI platforms, SDK/API development, GPU profiling, kernel-level optimization, reproducibility, packaging, versioning, or compatibility testing are advantageous.
Benefits
- Eligible for equity and benefits.
- Base salary varies by location, experience, and objective job-related factors; the stated ranges are $152,000-$241,500 for Level 3 and $184,000-$287,500 for Level 4.
- Applications are accepted at least until November 3, 2026.
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.