Nvidia

Software Engineer, Performance Instrumentation

Nvidia
Apply
1 day ago
Austin, TX, USA or Santa Clara, CA, USASenior
H1B sponsor

Base Salary

$168k - $270k/yr

Responsibilities

  • Define and maintain performance data requirements across profiling libraries, annotation APIs, frameworks, runtimes, communication libraries, schedulers, configurations, and infrastructure telemetry.
  • Identify visibility gaps and collaborate with partner teams to address them or build appropriate solutions.
  • Inform the design of low-overhead instrumentation and annotation APIs.
  • Implement data validation, sanitization, checks, alerting, and provenance controls at ingestion.
  • Measure and manage instrumentation overhead and observer effects on real workloads.
  • Coordinate commitments and delivery across multiple partner teams.

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, or a related field, or equivalent experience.
  • 8+ years of relevant software engineering experience, including production instrumentation or tracing in machine learning or systems software.
  • Proficiency with CUDA, Python, and C++.
  • Working knowledge of PyTorch or JAX and annotation or tracing APIs such as NVTX.
  • Experience maintaining data quality in a pipeline through validation, checks, alerting, and provenance.
  • Experience measuring instrumentation overhead and balancing overhead, fidelity, sampling, and aggregation.
  • Ability to implement changes in code managed by other groups and drive requirements, interface agreement, and delivery.
  • Strong debugging and validation skills across component boundaries.
  • Strong communication skills for conveying evidence, uncertainty, and next steps.
  • Preferred experience with telemetry conventions or schemas, storage, checkpointing, data-loading performance, low-overhead event collection, NCCL, NICs, and fabric counters.

Benefits

  • Eligible for equity and benefits.
  • The role is based in Santa Clara, California.
  • Applications will be accepted at least until November 2, 2026.

Categories

Nvidia

About Nvidia

10,000+ employees

Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.

Contact me