11 hours ago
Remote, United States or Remote, AmericasSenior
Responsibilities
- Design, stand up, and harden reliable and repeatable RL, coding, STEM, and other evaluation environments.
- Lead platform development for project pipelines from briefs through tasks, quality control, and delivery.
- Develop project taxonomies that remain coherent as domains and clients expand.
- Build and support administrative workflows for payments, payouts, task approval and rejection, RBAC, role management, and project revenue and cost visibility.
- Set technical direction, prioritize platform work, and improve system instrumentation and operability.
Requirements
- At least 4 years of senior software engineering experience or equivalent ownership, with backend or full-stack production web product experience.
- Experience owning a multi-sided platform serving operators, contributors, and internal stakeholders.
- Experience building or deeply operating human-data, RLHF, labeling, model-evaluation, RL/evaluation harness, annotation, or coding/STEM evaluation systems.
- Experience shipping administrative or back-office workflows involving approvals, permissions, payments or payouts, and operational metrics.
- Experience leading a technical initiative with high ambiguity on a small team.
- Ability to turn a complex human-data or evaluation domain into a roadmap and shipped systems.
- Working fluency with human-data and evaluation workflows, including tasks, quality control, environments, and expert workflows.
- Experience with environment orchestration such as containers, workers, or sandboxes is preferred.
- Prior work at or adjacent to Scale AI, Surge, Handshake AI, Labelbox, or similar platforms is preferred.
- Fluent English is required; Spanish is a nice-to-have.
Benefits
- Remote role available in LatAm and the US.