2 days ago
Base Salary
$272k - $431k/yr
Responsibilities
- Define the long-term technical roadmap for communication libraries across NVIDIA’s next-generation platforms.
- Lead the development of communication primitives and collective algorithms optimized for NVLink, Spectrum-X Ethernet, and Quantum-X InfiniBand.
- Partner with application developers to architect and implement specialized primitives for NCCL, NIXL, NVSHMEM, UCC, and UCX.
- Collaborate with silicon architects and software engineers on hardware specifications for next-generation networking.
- Develop high-fidelity analytical models and simulators for emerging AI and HPC workloads.
Requirements
- Ph.D. or M.S. in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
- 12+ years of industry experience in high-performance computing or distributed deep learning.
- Deep understanding of data, tensor, pipeline, context, and expert parallelism, as well as ZeRO variants.
- Technical proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI, plus required experience with RDMA, RoCE, and low-level InfiniBand verbs.
- Advanced knowledge of TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo.
- Expertise in NVIDIA GPU memory hierarchy, including HBM3e, HBM4, and L2 cache, and CUDA programming models.
- Experience with Megatron-Core, DeepSpeed, or JAX/XLA; open-source contributions; NVIDIA or rack-scale deployments; and patents or papers in systems and architecture venues are preferred.
Benefits
- Competitive salary, equity, and benefits package.
- Applications are accepted at least until November 3, 2026.
- This posting is for an existing vacancy.
Tech Stack
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.