5 months ago
Base Salary
$276k - $345k/yr
Responsibilities
- Own the evaluation strategy for AI agent integrations.
- Define metrics for quality and cost optimization.
- Build eval datasets and regression harnesses to catch quality changes.
- Drive improvements in retrieval relevance and tool-selection accuracy.
- Conduct applied research on agent-data interaction challenges.
- Provide technical leadership and represent the team externally.
Requirements
- BS/MS/PhD in a scientific field or equivalent experience.
- 10+ years of relevant engineering or applied science experience.
- Proven track record of leading ML or GenAI initiatives.
- Significant experience with evaluation and measurement of ML systems.
- Strong product mindset and ability to drive cross-functional initiatives.
- Ability to thrive in ambiguity and make sound technical decisions.
Benefits
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
- Continuous professional development and career pathing.
- An inclusive company culture and community engagement opportunities.
- Competitive global benefits including healthcare and mental health support.
Categories
Data Science
About Datadog
Datadog builds a SaaS observability and security platform that monitors infrastructure, applications, logs, and services for engineering and DevOps teams. Its products include infrastructure monitoring, APM, log management, real user monitoring, and cloud security, sold via subscriptions and used across cloud-native and hybrid environments. Founded in 2010 and headquartered in New York City, Datadog is a public company trading on NASDAQ under the ticker DDOG.