Nvidia

Senior Software Architect, AI Systems and Networking

Nvidia
Apply
1 day ago
Austin, TX, USA or Santa Clara, CA, USASenior
H1B sponsor

Base Salary

$224k - $431k/yr

Responsibilities

  • Architect and implement high-performance communication and memory-management libraries for distributed AI.
  • Drive hardware-software co-optimization across GPU, DPU, NIC, and switch teams using GPUDirect RDMA, NVLink, and next-generation interconnects.
  • Profile and optimize data movement across GPU memory, system DRAM, NVMe, and network fabrics.
  • Integrate networking capabilities into AI serving stacks including vLLM, SGLang, and TensorRT-LLM.
  • Contribute to open-source projects, mentor engineers, conduct design reviews, and prototype experimental technologies.

Requirements

  • 12+ years of systems software and/or networking experience with demonstrated ownership of complex projects.
  • MS, PhD, or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • Strong understanding of InfiniBand, RoCE, RDMA, NVLink, and GPUDirect.
  • Strong C, C++, or Rust systems programming skills with performance profiling and low-level debugging experience.
  • Understanding of transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.

Benefits

  • Competitive salary, equity, and comprehensive benefits package.
  • Salary varies by location, experience, and level; the stated base salary ranges are $224,000-$356,500 for Level 5 and $272,000-$431,250 for Level 6.
  • Applications are accepted at least until November 2, 2026.

Tech Stack

Categories

Nvidia

About Nvidia

10,000+ employees

Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.

Contact me