5 months ago
Seattle, WA, USA or San Francisco, CA, USAMid Level
H1B sponsor
Base Salary
$293k - $455k/yr
Responsibilities
- Develop systems and tooling to measure, monitor, and improve token throughput across first-party and partner-owned compute environments.
- Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure environments.
- Integrate external and partner infrastructure into internal compute, observability, and workload management systems.
- Develop and monitor metrics for billing, usage, SLAs, utilization, reliability, and throughput.
- Identify bottlenecks across hardware, networking, software, and workload enablement.
- Collaborate with compute, infrastructure, networking, finance, and operations teams to convert raw capacity into usable workload-serving capacity.
- Build dashboards, automation, and reporting systems for TaaS capacity, performance, and business outcomes.
Requirements
- Strong software engineering background building systems, tooling, automation, or infrastructure platforms.
- Experience with compute infrastructure, distributed systems, performance engineering, or production operations.
- Ability to analyze token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance.
- Experience integrating external systems or partner environments into internal infrastructure stacks.
- Strong analytical and debugging skills across hardware, networking, software, and operational domains.
- Preferred experience with GPU clusters, AI infrastructure, performance benchmarking, workload optimization, model porting, inference or training workloads, token economics, compute efficiency analysis, monitoring systems, observability, distributed systems, or platform engineering.
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.