8 hours ago
Base Salary
$136k - $170k/yr
Responsibilities
- Build and scale backend systems that evaluate and improve the quality of data delivered to frontier AI labs.
- Develop infrastructure for real-time and pre-delivery quality checks.
- Help design recommendation systems that select effective quality checks for each project.
- Build data pipelines and measurement systems for complex quality signals.
- Develop APIs and platform capabilities for other teams and tools.
- Surface Quality capabilities through MCP and other AI-native interfaces used by internal operators.
- Collaborate with engineering, research, product, and operations stakeholders on scalable technical solutions.
- Improve the reliability, efficiency, and cost-effectiveness of quality workflows.
Requirements
- At least 2 years of experience building and maintaining backend applications, services, or data-intensive systems.
- Strong software engineering fundamentals, including system design, testing, debugging, and operational reliability.
- Data-oriented problem-solving and measurement skills.
- Experience with APIs, databases, data pipelines, or distributed systems.
- Ability to break down ambiguous problems and deliver iteratively.
- Strong communication and collaboration skills across technical and non-technical teams.
- Interest in building rigorous systems for difficult-to-measure quality outcomes.
- Preferred experience includes machine learning, applied AI, AI-enabled products, model evaluation, experimentation, recommendation or ranking systems, annotation, data-labeling, workflow-orchestration platforms, developer platforms, internal tools, extensible APIs, MCP, agentic systems, or AI-native development tools.
Benefits
- Equity in a fast-growing company.
- 401(k) match, competitive compensation, and financial coaching.
- Paid parental leave, fertility benefits, and parental coaching.
- Medical, dental, vision, mental health support, and a wellness stipend.
- Learning stipend and ongoing development.
- Internet support, commuting benefits, free lunch, and gym access in the San Francisco office.
- Flexible PTO, 15 holidays, and 2 flex days.
- Team outings and referral bonuses.
- Full-time US employee benefits; in-office in San Francisco five days per week.
About Handshake
Handshake builds a career network and recruiting platform that connects college students and recent grads with employers, sold as SaaS to universities and subscriptions/solutions to employers. Founded in 2014 and headquartered in San Francisco, it serves 1,600+ educational institutions and over 1 million employers. The company also operates Handshake AI, which partners with frontier AI labs on human data collection and evaluations for model training and post-training workflows.