about 22 hours ago
Base Salary
$276k - $345k/yr
Responsibilities
- Own the evaluation strategy for AI agent integrations.
- Define metrics for quality and cost optimization.
- Build eval datasets and regression harnesses to catch quality changes.
- Drive improvements in retrieval relevance and tool-selection accuracy.
- Conduct applied research on agent-data interaction challenges.
- Provide technical leadership and represent the team externally.
Requirements
- BS/MS/PhD in a scientific field or equivalent experience.
- 10+ years of relevant engineering or applied science experience.
- Proven track record of leading ML or GenAI initiatives.
- Significant experience with evaluation and measurement of ML systems.
- Strong product mindset and ability to drive cross-functional initiatives.
- Ability to thrive in ambiguity and make sound technical decisions.
Benefits
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
- Continuous professional development and career pathing.
- An inclusive company culture and community engagement opportunities.
- Competitive global benefits including healthcare and mental health support.
Categories
AI & MLData Science