2 days ago
Base Salary
$184k - $357k/yr
Responsibilities
- Define and evolve technical approaches for evaluating and improving open agent harnesses across frameworks, models, and benchmark environments.
- Build and operate scalable, reproducible evaluation systems spanning CI, scheduled compute, sandboxed execution, artifact provenance, trace capture, and analysis.
- Diagnose agent failures using traces, logs, tool results, and benchmark artifacts.
- Design controlled experiments and promotion criteria to distinguish genuine harness improvements from noise and model-specific gains.
- Ship harness and runtime improvements, upstream open-source contributions, detectors, regression tests, and maintainable documentation.
- Partner with Relay, Hermes, model, infrastructure, and research teams to create reusable runtime, trace, and evaluation capabilities.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Applied Math, or a related field, or equivalent experience.
- 8+ years of hands-on software engineering experience with technical ownership of production systems and architecture design leadership.
- Expert Python skills and working proficiency in Rust, Go, C++, or TypeScript, including debugging across language and process boundaries.
- Experience building or extending LLM agents, coding agents, tool-use loops, model-provider integrations, developer tools, or evaluation infrastructure.
- Understanding of asynchronous execution, subprocesses, containers, sandboxing, callbacks, retries, networking, and distributed compute.
- Experience with reproducible experiments, benchmark methodology, performance investigations, regression gates, or reliability analysis under nondeterministic conditions.
- Record of shipping and maintaining open-source or developer-facing software with testing, API development, documentation, and code reviews.
- Preferred experience includes open-source coding agents or harnesses, published research or technical writing, SWE-bench, Terminal-Bench, AgentBench, context management, tool interfaces, sandboxed repository execution, and observability systems such as OpenTelemetry or OpenInference.
Benefits
- Competitive base salary, equity, and comprehensive benefits package.
- Salary varies by location, experience, and objective job-related factors, with the listed ranges applying to Level 4 and Level 5.
- NVIDIA offers benefits for employees and their families.
- Applications are accepted at least until November 3, 2026.
Tech Stack
Categories
About Nvidia
Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.