3 months ago
Base Salary
$240k - $280k/yr
Responsibilities
- Design and build robust evaluation frameworks for AI systems.
- Create and curate high-quality datasets and benchmarks from real production data.
- Build automated test harnesses and metrics pipelines for continuous evaluation.
- Collaborate with applied AI engineers and product leaders to define measurable criteria.
- Own the evaluation lifecycle for major AI initiatives from experimentation to production monitoring.
Requirements
- Minimum 5+ years of professional experience in software engineering.
- Bachelor’s degree in computer science, machine learning, or a related field.
- Experience building testing or evaluation infrastructure for complex systems.
- Proficiency in writing production-quality code, preferably in Python and TypeScript.
- Familiarity with modern ML systems and evaluation techniques.
Benefits
- Eligible for incentive compensation and equity grants.
- Paid time off and group health insurance coverage.
- Hybrid work model with in-office anchor days.