about 2 hours ago
Menlo Park, CA, USASenior / Staff+
H1B Sponsor
Base Salary
$199k - $300k/yr
Responsibilities
- Build and evaluate self-built, frontier and fine-tuned models across quality, latency, cost, and edge cases.
- Partner with product managers, data scientists, and engineers to translate evaluation results into clear launch criteria for AI systems.
- Analyze production issues, identify root causes, and prioritize improvements to increase system reliability and performance.
- Build visibility into model performance through metrics, monitoring, and reporting that inform roadmap decisions.
Requirements
- Experience building complex and impactful production ML models and systems.
- Deep experience defining and measuring quality for machine learning systems using evaluation frameworks.
- Demonstrated ability to analyze production issues and lead initiatives that improve system quality.
- Comfortable working with engineers, data scientists, and product partners to deliver measurable improvements.
- Experience building or operating systems in regulated environments or working with AI evaluation and observability tools is a plus.
Benefits
- Challenging, high-impact work to grow your career.
- Performance driven compensation with multipliers for outsized impact, bonus programs, equity ownership, and 401(k) matching.
- 100% paid health insurance for employees with 90% coverage for dependents.
- Lifestyle wallet for wellness, learning, and more.
- Employer-paid life & disability insurance, fertility benefits, and mental health benefits.
- Time off to recharge including company holidays, paid time off, sick time, parental leave, and more.
- Exceptional office experience with catered meals, events, and comfortable workspaces.
Categories
AI & MLData Science