Nvidia

Senior Software Engineer, NeMo Core Platform

Nvidia
Apply
2 days ago
Remote, Canada or Toronto, CanadaSenior

Responsibilities

  • Design an agentic execution system that operates across local, Docker, Kubernetes, Slurm, on-premises, and air-gapped environments.
  • Build and maintain core platform APIs for jobs, data, entities, secrets, RBAC, and authentication.
  • Extend the plugin architecture so teams and external customers can install new capabilities.
  • Provide technical leadership through architecture and code reviews, mentoring, and ownership of ambiguous cross-component problems.
  • Improve reliability, observability, debuggability, performance, and developer workflows across the platform, SDKs, plugins, and jobs.
  • Build strong unit, integration, end-to-end, Docker, and Kubernetes test coverage.
  • Develop and maintain open-source software in NVIDIA’s NeMo Platform repository.

Requirements

  • BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field.
  • 10+ years of professional software engineering experience building production systems.
  • Strong system design skills and understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure.
  • Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
  • Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design.
  • Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces.
  • Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries.
  • Strong verbal and written communication skills, including producing and reviewing architectural RFCs.
  • Preferred experience building and operating production agentic AI systems at scale in Kubernetes.
  • Preferred experience with sophisticated plugin architectures and enterprise AI systems involving measurement, regression testing, observability, governance, and continuous improvement.

Benefits

  • Base salary is CAD 170,000–220,000 for Level 4 or CAD 225,000–275,000 for Level 5, depending on location, experience, and comparable employee pay.
  • Eligible for equity and benefits.
  • Applications are accepted at least until October 2, 2026.
  • This posting is for an existing vacancy.
Nvidia

About Nvidia

10,000+ employees

Nvidia designs and sells GPUs and accelerated computing platforms for data centers, AI/ML, graphics, gaming, and automotive, monetizing through hardware, software platforms (CUDA, AI frameworks), and systems like DGX and networking. Customers include cloud providers, enterprises, researchers, and OEMs. Founded in 1993 and headquartered in Santa Clara, it is a public company traded on NASDAQ under NVDA.

Contact me