3 months ago
Base Salary
$276k - $345k/yr
Responsibilities
- Own the Dashboards and broader organization’s evaluation strategy and define offline, online, quality, cost, single-turn, and multi-turn metrics
- Build evaluation datasets, golden traces, and regression harnesses reusable by teams developing dashboards and widgets through agents
- Drive improvements to retrieval relevance, tool-selection accuracy, and context efficiency in partnership with engineers
- Provide technical leadership through design reviews, working groups, and mentorship
Requirements
- BS, MS, or PhD in a scientific field, or equivalent experience
- 10+ years of relevant engineering or applied science experience, including experience as a technical lead
- Proven track record leading ML or GenAI initiatives in a product-driven environment from research through production
- Significant experience evaluating, experimenting with, or measuring ML systems at scale
- Strong product mindset and ability to drive cross-functional initiatives
- Ability to make sound technical decisions in ambiguous environments
Benefits
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
- Continuous professional development, product training, and career pathing
- Inclusive company culture, giving programs, and employee resource groups through Community Guilds
- Global benefits, including healthcare, dental, parental planning, mental health benefits, 401(k) plan and match, paid time off, fitness reimbursements, and Spring Health benefits
- Hybrid workplace with office collaboration
Categories
About Datadog
Datadog is the essential monitoring platform for cloud applications. We bring together data from servers, containers, databases, and third-party services to make your stack entirely observable. These capabilities help DevOps teams avoid downtime, resolve performance issues, and ensure customers are getting the best user experience.