1 day ago
Shanghai, ChinaSenior
Responsibilities
- Develop infrastructure software and tools for large-scale AI, LLM, and GenAI infrastructure.
- Optimize tools and systems for infrastructure efficiency, resiliency, and availability.
- Root-cause, analyze, and triage failures from the application level to the hardware level.
- Enhance infrastructure and products supporting NVIDIA's AI platforms.
- Co-design and implement APIs integrating with NVIDIA's resiliency stacks.
- Define actionable reliability metrics to track and improve system and service reliability.
Requirements
- 8+ years of experience developing software infrastructure for large-scale AI systems.
- Bachelor's degree or higher in Computer Science or a related technical field, or equivalent experience.
- Strong debugging skills and experience analyzing and triaging AI applications across the application-to-hardware stack.
- Proven experience building and scaling large-scale distributed systems.
- Experience with AI training and inference and data infrastructure services.
- Experience operating large-scale observability platforms for monitoring and logging, such as ELK, Prometheus, or Loki.
- Proficiency in Python, C/C++, and scripting languages.
- Experience with large-scale AI clusters, NVIDIA GPUs, RDMA, InfiniBand, and NCCL is preferred.
- Understanding of PyTorch, TensorFlow, JAX, and Ray internals is preferred.
- Strong software design and development background, problem-solving ability, and communication and collaboration skills.
Benefits
- Autonomy to work on meaningful projects with mentorship and support.
- Participation in a dynamic, supportive, and diverse culture emphasizing learning, intellectual curiosity, openness, blameless postmortems, and iterative improvement.
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.