Nvidia

Senior AI Infrastructure Software Engineer - DGX Cloud

Nvidia
Apply
1 day ago
Redmond, WA, USA +2 moreSenior
H1B sponsor

Base Salary

$184k - $357k/yr

Responsibilities

  • Develop platforms and tools for large-scale AI, LLM, and generative AI infrastructure.
  • Optimize tools and infrastructure to improve AI/ML workload efficiency and resiliency.
  • Root-cause, analyze, and triage failures from the application level through the hardware level.
  • Enhance infrastructure and products supporting NVIDIA AI platforms.
  • Co-design and implement APIs integrating with NVIDIA resiliency stacks.
  • Define actionable reliability metrics to improve system and service reliability.

Requirements

  • At least 8 years of experience developing software infrastructure for large-scale AI systems.
  • Bachelor’s degree or higher in computer science or a related technical field, or equivalent experience.
  • Strong debugging, root-cause analysis, and AI application triage skills across application and hardware layers.
  • Proven experience building and scaling large-scale distributed systems.
  • Experience with AI training, inference, and data infrastructure services.
  • Familiarity with Kubernetes and large-scale observability platforms for monitoring and logging, including ELK, Prometheus, or Loki.
  • Proficiency in Golang, Python, C/C++, and scripting languages.
  • Preferred experience with large-scale AI clusters, cloud-native infrastructure, NVIDIA GPUs, RDMA, InfiniBand, NCCL, PyTorch, TensorFlow, JAX, Dynamo, and Ray.
  • Strong software design and development background, communication skills, and collaborative problem-solving ability.

Benefits

  • Base salary is listed in Level 4 and Level 5 ranges of $184,000–$287,500 and $224,000–$356,500 respectively.
  • Eligible for equity and benefits.
  • Applications are accepted at least until September 20, 2026.
  • NVIDIA promotes an inclusive, equal-opportunity work environment.

Tech Stack

CC++GoKubernetesPrometheusPythonPyTorchTensorFlow
Nvidia

About Nvidia

10,000+ employees

Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.

Contact me