15 hours ago
Pune, IndiaSenior
Responsibilities
- Partner with benchmarking, inference, and AI application teams to define and maintain infrastructure for deploying, benchmarking, and qualifying AI workloads.
- Build Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware, operating systems, and runtime configurations.
- Develop services for downloading, versioning, caching, and synchronizing models, checkpoints, and dependencies.
- Design databases, backend services, and data pipelines for model metadata, benchmark results, telemetry, and execution artifacts.
- Create dashboards and reports for comparing inference configurations, identifying regressions, and investigating performance bottlenecks.
- Develop and operate server infrastructure covering environment provisioning, workload scheduling, resource management, and failure recovery.
- Develop autonomous AI agents for infrastructure management, workload orchestration, monitoring, and diagnostics with access controls and safeguards.
- Maintain Git repositories and companion websites containing code, documentation, model recommendations, and evaluation results.
- Implement instrumentation and debugging capabilities and improve infrastructure efficiency and scalability.
Requirements
- B.Tech or higher in Computer Science, Computer Engineering, Information Technology, Software Engineering, or a related field, or equivalent experience.
- At least five years of relevant software development experience.
- Strong programming skills in Python, C/C++, C#, or another systems programming language.
- Experience developing system software, backend services, or infrastructure supporting engineering development.
- Understanding of system APIs, multithreading, process and resource management, and systems debugging.
- Hands-on experience with Git-based CI, databases, SQL, and data modeling.
- Strong analytical, problem-solving, project ownership, prioritization, and cross-team communication skills.
- Preferred experience integrating or debugging AI inference frameworks and building model evaluation or benchmarking platforms.
- Preferred proficiency with AI agents, tool integration, autonomous infrastructure workflow evaluation, telemetry, observability, Grafana or Kibana, and technical documentation or benchmark websites.
Benefits
- Competitive salaries and a generous benefits package are provided.
- The posting describes the position as part of NVIDIA's growing engineering organization; no remote, hybrid, or office schedule is stated.
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.