Base Salary
$230k - $325k/yr
Responsibilities
- Design and iterate on agent behaviors for real-world coding tasks and long-horizon workflows.
- Develop and run evaluations to measure performance, regressions, failure modes, and edge cases.
- Improve agents through prompting, tool-use strategies, context construction, and model-facing experimentation.
- Analyze production failures and systematically improve robustness and reliability.
- Build feedback loops and data systems that provide better real-task data for evaluation and research.
- Collaborate with product teams on user-facing agent experiences and agent interfaces.
- Help define success criteria for agents completing complex tasks end to end.
Requirements
- Experience building or shipping machine learning or LLM-powered products.
- Strong Python skills and comfort with modern ML tooling.
- Experience with model evaluation, fine-tuning, or prompt design.
- Systems-oriented thinking focused on user outcomes and real-world reliability.
- Experience with agent frameworks or tool-using LLM systems is a bonus.
- Research experience with code-generation models or developer tooling is a bonus.
- Experience working with large, messy datasets or production logs is a bonus.
Tech Stack
Categories
About OpenAI
OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.