about 2 hours ago
Base Salary
$295k - $445k/yr
Responsibilities
- Design and run experiments to improve agent behavior with complex software.
- Own end-to-end improvements to the post-training stack, including data pipelines and model analysis.
- Build evaluations and environments to identify model failures and create training data.
- Collaborate with product teams to translate user needs into model enhancements.
- Work on early-training interventions that shape agent behavior.
- Decide on integrations and capabilities for major model runs.
- Enhance the machinery for large-scale training and launch.
- Debug failures in models and develop hypotheses for improvements.
Requirements
- Strong technical fundamentals in machine learning, software engineering, or related fields.
- Hands-on experience with LLMs, RL, and model training systems.
- Ability to tackle open-ended problems with research and engineering skills.
- Focus on product impact and model behavior over mere benchmark performance.
- Capability to transition from behavioral problems to concrete experiments.
- Comfortable working across various teams and communicating effectively.
- Willingness to build systems and processes as needed by the team.