about 6 hours ago
Base Salary
$216k - $270k/yr
Responsibilities
- Build observability tools to monitor agent behavior in production.
- Design evaluation methodologies and metrics for agentic applications.
- Develop ML systems to detect drift, anomalies, or misalignment in agent behavior.
- Run rigorous experiments to validate model and agent performance improvements.
- Collaborate with software engineers to productionize research and experimental work.
- Translate enterprise and government requirements into robust platform capabilities.
Requirements
- 5+ years of experience as an ML engineer or applied scientist on production ML systems.
- Strong grounding in building evaluation, monitoring, or continuous-learning infrastructure.
- Hands-on experience with LLMs and agent architectures.
- Comfortable partnering with software engineers for productionizing research.
- Rigorous approach to experimentation with clear hypotheses and statistical grounding.
- Track record of collaborating across functions to navigate ambiguous requirements.
Benefits
- Comprehensive health, dental, and vision coverage.
- Retirement benefits.
- Learning and development stipend.
- Generous PTO.
- Potential commuter stipend.
Categories
AI & MLData Science