3 days ago
Base Salary
$152k - $288k/yr
Responsibilities
- Optimize, analyze, profile, tune, and scale deep learning models across LLM, multimodal, and generative AI workloads.
- Scale model performance across different NVIDIA GPU and accelerator architectures, including datacenter GPUs and edge SoCs.
- Develop and contribute features and code to NVIDIA inference libraries, vLLM, SGLang, FlashInfer, and related LLM software solutions.
- Implement and optimize model-serving pipelines using GPU programming, open-source tools, plugins, and inference frameworks.
- Collaborate with teams across frameworks, NVIDIA libraries, and inference optimization initiatives.
Requirements
- Master’s degree or PhD in a relevant field such as Computer Engineering, Computer Science, EECS, or AI, or equivalent experience.
- At least 5 years of relevant software development experience.
- Excellent C/C++ programming and software design skills.
- Experience with software development practices; Python experience is a plus.
- Experience training, deploying, or optimizing deep learning model inference in production is preferred.
- Experience with performance modeling, profiling, debugging, code optimization, or CPU/GPU architecture is preferred.
- GPU programming experience with CUDA, OAI Triton, or CUTLASS is preferred.
- Contributions to deep learning software projects such as PyTorch, vLLM, or SGLang are advantageous.
- Experience with multi-GPU communications technologies such as NCCL or NVSHMEM is advantageous.
Benefits
- Hybrid work arrangement.
- Base salary ranges from $152,000-$241,500 for Level 3 and $184,000-$287,500 for Level 4, plus equity and benefits.
- Applications are accepted at least until October 16, 2026.
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.