5 days ago
Pune, IndiaMid Level
Responsibilities
- Partner with software, research, architecture, and product teams to align technical strategies and grow the AI ecosystem on RTX and DGX PCs.
- Build and optimize local AI inference stacks for RTX, RTX Pro, and DGX GPUs across different hardware architectures.
- Architect and develop inference runtimes and execution stacks for LLM, vision-language, TTS, ASR, and diffusion workloads.
- Optimize AI models, data pipelines, and inference runtimes using quantization, pruning, sparsity, and distillation.
- Develop performance and accuracy sweep infrastructure, perform system-level debugging, analyze trade-offs, and drive fixes toward production readiness.
Requirements
- 2+ years of experience and a bachelor's, master's, or PhD in Computer Science, Software Engineering, Mathematics, or a related field, or equivalent experience.
- Excellent C++ programming and debugging skills with strong knowledge of data structures, algorithms, and machine learning.
- Proven experience with AI inference pipelines and applications using frameworks such as Llama.cpp, vLLM, PyTorch, WinML, DXCGC, and TensorRT.
- Deep interest in inference backends and runtime internals, including scheduling, memory management, KV-cache behavior, graph execution, quantization, and hardware-aware optimization.
- Strong analytical, problem-solving, multitasking, written communication, and oral communication skills.
- Preferred qualifications include knowledge of modern machine learning, deep neural networks, and generative AI; open-source contributions; end-to-end product delivery; CUDA and lower-level GPU programming; and experience with Vulkan and DirectX.
Benefits
- The posting mentions competitive salaries and a generous benefits package.
- The employer is an equal-opportunity employer that values diversity.
Categories
About Nvidia
Since its founding in 1993, NVIDIA (NASDAQ: NVDA) has been a pioneer in accelerated computing. The company’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined computer graphics, ignited the era of modern AI and is fueling the creation of the metaverse. NVIDIA is now a full-stack computing company with data-center-scale offerings that are reshaping industry.