2 days ago
Base Salary
$272k - $431k/yr
Responsibilities
- Set the long-term technical vision for distributed AI communication systems across GPUs, storage, and nodes.
- Conduct original research and prototype networking solutions using RDMA, NVLink, and GPUDirect.
- Drive hardware-software co-optimization across GPUs, DPUs, NICs, and network switches.
- Investigate communication bottlenecks in large-scale AI workloads, including KV cache transfer, disaggregated prefill/decode, and model parallelism.
- Integrate networking capabilities into vLLM, SGLang, TensorRT-LLM, and other AI serving stacks.
- Publish findings, represent NVIDIA in industry forums and standards bodies, and mentor senior engineers.
- Define and deliver complex cross-team initiatives from research concept through production.
Requirements
- 15+ years of experience in systems software and/or networking with deep expertise in high-performance networking, including InfiniBand, RoCE, RDMA, and NVLink.
- Experience with communication libraries such as NIXL, NCCL, UCX, MPI, and NVSHMEM, plus GPU-accelerated systems.
- MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
- Deep understanding of computer architecture, memory hierarchies, DMA engines, and OS-level networking.
- Understanding of ML systems concepts such as transformer architectures, KV cache mechanics, model parallelism, and distributed training or inference.
- Proficiency in C, C++, Rust, and Python.
- Knowledge of vLLM, SGLang, TensorRT-LLM, CUDA programming, and NVIDIA GPU architecture is preferred.
- Experience influencing product strategy and technical roadmaps, making major open-source contributions, and leading senior-level technical initiatives is preferred.
Benefits
- Competitive salary, equity, and a comprehensive benefits package.
- Applications are accepted at least until November 3, 2026; the posting is for an existing vacancy.
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.