Base Salary
$293k - $385k/yr
Responsibilities
- Design, build, and operate durable APIs and control-plane services for multi-hour or multi-day optimization campaigns, including scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
- Build secure partner-side runner and grader software that compiles, executes, verifies, and benchmarks candidate artifacts on third-party accelerator hardware.
- Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into repeatable optimization workflows.
- Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and strong developer ergonomics.
- Develop correctness and performance evaluation systems covering latency, throughput, memory use, utilization, and cost efficiency.
- Build artifact, provenance, and qualification workflows for optimized kernels, binaries, configurations, and reports.
- Collaborate with research, inference engineering, infrastructure, security, product, and strategic partnerships teams.
- Drive technical architecture and execution across ambiguous, cross-functional initiatives connecting OpenAI systems with partner environments.
Requirements
- 8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services, or equivalent depth of experience.
- Strong programming skills in one or more of C++, Python, Go, or Rust.
- Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
- Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
- Experience debugging complex systems and using measurement, profiling, and benchmarks to guide engineering decisions.
- Proven ability to lead complex technical initiatives as a senior individual contributor and work effectively across organizational boundaries.
- Preferred experience with AI infrastructure, inference-serving systems, or large-scale machine learning systems.
- Preferred experience with compilers, runtimes, kernel optimization, or performance engineering, including familiarity with LLVM, MLIR, Triton, CUDA, or ROCm.
- Familiarity with GPUs, accelerators, hardware architecture, ISA concepts, or vendor toolchains.
- Experience with inference-serving frameworks or engines such as vLLM, SGLang, or Triton Inference Server.
- Experience building developer platforms, external APIs, remote execution systems, or secure partner-facing infrastructure.
- Experience working with strategic cloud, hardware, or infrastructure partners.
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.