5 months ago
Base Salary
$276k - $345k/yr
Responsibilities
- Own the Dashboards and broader organization’s evaluation strategy and define offline, online, quality, cost, single-turn, and multi-turn metrics
- Build evaluation datasets, golden traces, and regression harnesses reusable by teams developing dashboards and widgets through agents
- Drive improvements to retrieval relevance, tool-selection accuracy, and context efficiency in partnership with engineers
- Provide technical leadership through design reviews, working groups, and mentorship
Requirements
- BS, MS, or PhD in a scientific field, or equivalent experience
- 10+ years of relevant engineering or applied science experience, including experience as a technical lead
- Proven track record leading ML or GenAI initiatives in a product-driven environment from research through production
- Significant experience evaluating, experimenting with, or measuring ML systems at scale
- Strong product mindset and ability to drive cross-functional initiatives
- Ability to make sound technical decisions in ambiguous environments
Benefits
- New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
- Continuous professional development, product training, and career pathing
- Inclusive company culture, giving programs, and employee resource groups through Community Guilds
- Global benefits, including healthcare, dental, parental planning, mental health benefits, 401(k) plan and match, paid time off, fitness reimbursements, and Spring Health benefits
- Hybrid workplace with office collaboration
Categories
About Datadog
Datadog builds a SaaS observability and security platform that monitors infrastructure, applications, logs, and services for engineering and DevOps teams. Its products include infrastructure monitoring, APM, log management, real user monitoring, and cloud security, sold via subscriptions and used across cloud-native and hybrid environments. Founded in 2010 and headquartered in New York City, Datadog is a public company trading on NASDAQ under the ticker DDOG.