OpenAI

Tokens-as-a-Service (Taas) Software Engineer

OpenAI
Apply
4 months ago
Seattle, WA, USA or San Francisco, CA, USAMid Level
H1B Sponsor

Base Salary

$293k - $455k/yr

Responsibilities

  • Develop systems and tooling to measure, monitor, and improve token throughput across first-party and partner-owned compute environments.
  • Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure environments.
  • Integrate external and partner infrastructure into internal compute, observability, and workload management systems.
  • Develop and monitor metrics for billing, usage, SLAs, utilization, reliability, and throughput.
  • Identify bottlenecks across hardware, networking, software, and workload enablement.
  • Collaborate with compute, infrastructure, networking, finance, and operations teams to convert raw capacity into usable workload-serving capacity.
  • Build dashboards, automation, and reporting systems for TaaS capacity, performance, and business outcomes.

Requirements

  • Strong software engineering background building systems, tooling, automation, or infrastructure platforms.
  • Experience with compute infrastructure, distributed systems, performance engineering, or production operations.
  • Ability to analyze token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance.
  • Experience integrating external systems or partner environments into internal infrastructure stacks.
  • Strong analytical and debugging skills across hardware, networking, software, and operational domains.
  • Preferred experience with GPU clusters, AI infrastructure, performance benchmarking, workload optimization, model porting, inference or training workloads, token economics, compute efficiency analysis, monitoring systems, observability, distributed systems, or platform engineering.

Categories

OpenAI

About OpenAI

1,001-5,000 employees

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.