21 hours ago
Base Salary
$381k - $510k/yr
Responsibilities
- Build, deploy, and operate production classification and evaluation systems for post-training and research teams.
- Optimize production inference through model serving, batching, caching, throughput, latency, compute utilization, and cost improvements.
- Train and optimize classifiers using supervised fine-tuning and distillation, then validate quality and efficiency before deployment.
- Own classifier reliability and observability, diagnose production issues, and improve deployed performance over time.
- Design evaluations covering accuracy, calibration, generalization, and measurement bias while guiding production tradeoffs.
- Partner with software engineers to integrate models into reliable execution systems and support safe rollouts.
- Build reusable tools for classifier training, evaluation, deployment, and iteration.
- Translate researcher and data scientist needs into modeling objectives, evaluation criteria, and production requirements.
Requirements
- Experience taking machine-learning projects from problem formulation and experimentation through production deployment.
- Strong foundations in supervised learning, statistics, and experimental design.
- Practical experience evaluating models, investigating systematic errors, and working with imperfect labels.
- Strong software engineering skills and ability to build maintainable production machine-learning systems.
- Experience reasoning about inference performance and quality, latency, and compute-cost tradeoffs.
- Ability to combine scientific judgment with a practical approach to shipping and operating software.
- Comfort collaborating with researchers and engineers on open-ended problems.
- Fluency using AI agents across multiple workstreams in a fast-paced environment.
- Experience with model distillation, representation learning, calibration, or efficient inference is preferred.
Categories
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.