3 months ago
Base Salary
$276k - $345k/yr
Responsibilities
- Own the evaluation strategy for AI agent integrations.
- Define metrics for quality and cost optimization.
- Build eval datasets and regression harnesses to catch quality changes.
- Drive improvements in retrieval relevance and tool-selection accuracy.
- Conduct applied research on agent-data interaction challenges.
- Provide technical leadership and represent the team externally.
Requirements
- BS/MS/PhD in a scientific field or equivalent experience.
- 10+ years of relevant engineering or applied science experience.
- Proven track record of leading ML or GenAI initiatives.
- Significant experience with evaluation and measurement of ML systems.
- Strong product mindset and ability to drive cross-functional initiatives.
- Ability to thrive in ambiguity and make sound technical decisions.
Benefits
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
- Continuous professional development and career pathing.
- An inclusive company culture and community engagement opportunities.
- Competitive global benefits including healthcare and mental health support.
Categories
Data Science
About Datadog
Datadog is the essential monitoring platform for cloud applications. We bring together data from servers, containers, databases, and third-party services to make your stack entirely observable. These capabilities help DevOps teams avoid downtime, resolve performance issues, and ensure customers are getting the best user experience.