2 months ago
Base Salary
$130k - $250k/yr
Responsibilities
- Develop a working understanding of customer model capabilities and gaps.
- Evaluate model outputs and create targeted loss analysis.
- Translate research goals into task designs and quality specifications.
- Design and continuously improve data production pipelines.
- Prototype new generation and validation approaches.
- Manage end-to-end data pipelines from specification to delivery.
- Diagnose bottlenecks and implement workflow solutions.
- Act as the primary contact for AI labs and deliver consistent reporting.
- Design human-expert labeling and evaluation workflows.
- Source, vet, train, and manage teams of domain experts.
Requirements
- Technical judgment with coding literacy and familiarity with ML or model benchmarks.
- A track record of running complex, high-stakes projects end to end.
- Strong analytical and communication skills for customer engagement.
- Experience in designing data or automation pipelines is a bonus.
- Research fluency in connecting model literature to data needs is a plus.
Benefits
- Bi-annual performance bonus structure.
- Generous equity grant vested over 4 years.
- Up to $15k relocation bonus.
- $10K housing bonus for living within 0.5 miles of the office.
- $1.5K monthly stipend for meals.
- Free Equinox membership.
- $200 monthly laundry reimbursement.
- $200 monthly personal wellness reimbursement.
- Health, dental, and vision insurance.
Categories
Data ScienceDevOps
About Mercor
We find the best experts in every professional domain and put their knowledge to work training frontier models. Through APEX, we measure whether those models can actually perform economically valuable work. We're also bringing that expertise to enterprises: deploying custom AI agents, staffing teams with vetted domain experts, and helping organizations encode their own knowledge into AI systems.