OpenAI

Software Engineer, AI accelerator Runtime

OpenAI
Apply
2 months ago

Base Salary

$266k - $445k/yr

Responsibilities

  • Design and implement the low-level device runtime for OpenAI’s custom silicon.
  • Build kernel-launch scheduling, command submission, queueing, dependency tracking, and completion handling.
  • Manage device memory spaces, allocation, virtual-to-physical mappings, data movement, and lifetimes across concurrent workloads.
  • Implement synchronization primitives, events, barriers, streams, and ordering guarantees.
  • Define interfaces between the runtime, drivers, firmware, compiler-generated code, kernels, and higher-level execution systems.
  • Use event-based, cycle-accurate simulators to develop, validate, debug, and performance-tune runtime behavior.
  • Diagnose concurrency, memory-ordering, deadlock, race, correctness, and performance issues across software and hardware boundaries.
  • Build tests, tracing, profiling, observability, and reproducible workloads for runtime correctness and performance.
  • Partner with architecture and silicon teams to improve hardware-software interfaces based on workload and simulator insights.

Requirements

  • Strong low-level systems programming experience in C, C++, Rust, or comparable environments.
  • Experience building runtimes, drivers, firmware, operating-system components, accelerator software, or adjacent systems infrastructure.
  • Understanding of concurrency, synchronization, asynchronous execution, queues, events, and memory-ordering semantics.
  • Understanding of memory management, address spaces, DMA, caching, coherency, and hardware-software interfaces.
  • Hands-on experience with event-based, cycle-accurate simulators or closely related architectural and performance models.
  • Ability to reason quantitatively about scheduling, latency, throughput, utilization, contention, and resource tradeoffs.
  • Skill debugging failures spanning software abstractions, device interfaces, and hardware behavior.
  • Ability to collaborate across compiler, kernel, architecture, verification, firmware, and silicon teams.
  • Candidates may need to meet legal-status requirements under U.S. export control laws and regulations.

Tech Stack

Categories

OpenAI

About OpenAI

10,000+ employees

OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.

Contact me