6 months ago
London, United Kingdom +3 moreMid Level
H1B sponsor
Base Salary
$230k - $325k/yr
Responsibilities
- Design and iterate on agent behaviors for real-world coding tasks and long-horizon workflows.
- Develop and run evaluations to measure performance, regressions, failure modes, and edge cases.
- Improve agents through prompting, tool-use strategies, context construction, and model-facing experimentation.
- Analyze production failures and systematically improve robustness and reliability.
- Build feedback loops and data systems that provide better real-task data for evaluation and research.
- Collaborate with product teams on user-facing agent experiences and agent interfaces.
- Help define success criteria for agents completing complex tasks end to end.
Requirements
- Experience building or shipping machine learning or LLM-powered products.
- Strong Python skills and comfort with modern ML tooling.
- Experience with model evaluation, fine-tuning, or prompt design.
- Systems-oriented thinking focused on user outcomes and real-world reliability.
- Experience with agent frameworks or tool-using LLM systems is a bonus.
- Research experience with code-generation models or developer tooling is a bonus.
- Experience working with large, messy datasets or production logs is a bonus.
Tech Stack
Categories
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.