3 months ago
Base Salary
$293k - $385k/yr
Responsibilities
- Design, build, and operate durable APIs and control-plane services for multi-hour or multi-day optimization campaigns, including scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
- Build secure partner-side runner and grader software that compiles, executes, verifies, and benchmarks candidate artifacts on third-party accelerator hardware.
- Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into repeatable optimization workflows.
- Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and strong developer ergonomics.
- Develop correctness and performance evaluation systems covering latency, throughput, memory use, utilization, and cost efficiency.
- Build artifact, provenance, and qualification workflows for optimized kernels, binaries, configurations, and reports.
- Collaborate with research, inference engineering, infrastructure, security, product, and strategic partnerships teams.
- Drive technical architecture and execution across ambiguous, cross-functional initiatives connecting OpenAI systems with partner environments.
Requirements
- 8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services, or equivalent depth of experience.
- Strong programming skills in one or more of C++, Python, Go, or Rust.
- Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
- Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
- Experience debugging complex systems and using measurement, profiling, and benchmarks to guide engineering decisions.
- Proven ability to lead complex technical initiatives as a senior individual contributor and work effectively across organizational boundaries.
- Preferred experience with AI infrastructure, inference-serving systems, or large-scale machine learning systems.
- Preferred experience with compilers, runtimes, kernel optimization, or performance engineering, including familiarity with LLVM, MLIR, Triton, CUDA, or ROCm.
- Familiarity with GPUs, accelerators, hardware architecture, ISA concepts, or vendor toolchains.
- Experience with inference-serving frameworks or engines such as vLLM, SGLang, or Triton Inference Server.
- Experience building developer platforms, external APIs, remote execution systems, or secure partner-facing infrastructure.
- Experience working with strategic cloud, hardware, or infrastructure partners.
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.