1 day ago
Santa Clara, CA, USAEntry Level / Mid Level / Senior / Staff+
H1B sponsor
Base Salary
$124k - $242k/yr
Responsibilities
- Build and support Transformer Engine, an open-source library for accelerating large language model training.
- Conduct systems research and implement techniques such as low-precision training and parallelism to improve deep learning performance.
- Implement, benchmark, and optimize deep learning models, including LLMs, for NVIDIA GPUs and systems.
- Contribute to NVIDIA submissions for community benchmarks such as MLPerf.
- Engage with open-source communities and support enterprise customers and partners.
- Influence the design of future NVIDIA hardware generations and core platform software components.
Requirements
- Bachelor’s degree in Computer Science, Electrical Engineering, or a related field, or equivalent experience.
- At least 2 years of experience programming in C++ and Python.
- Strong background, experience, or coursework in parallel systems programming, preferably on GPUs.
- Knowledge of computer architecture, code optimization, and/or operating systems.
- Proven experience developing large software projects.
- Excellent verbal and written communication skills.
- Preferred experience includes PyTorch, JAX, deep learning frameworks, performance analysis, profiling, multi-GPU or multi-node systems, LLM architectures, attention mechanisms, cuBLAS, cuDNN, cuSOLVER, CUDA, OpenAI Triton, CuTeDSL, Pallas, and open-source contributions.
Benefits
- Equity and benefits are provided.
- Base salary varies by location, experience, and comparable employee pay.
- Applications will be accepted at least until October 9, 2026.
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.