13 hours ago
Responsibilities
- Build full-stack tools for reviewing tasks, inspecting agent trajectories, checking graders, and investigating data-quality issues.
- Create dashboards and metrics for quality trends, failure modes, and review and validation workflow health.
- Design backend services, APIs, and data workflows connecting quality checks with task creation, evaluation, and feedback to data creators.
- Work with quality and research engineers to turn evolving review methods into scalable workflows.
- Move proven internal tools into production and improve their reliability, usability, and observability.
- Investigate issues in live workflows and improve the platform to prevent recurring failures.
Requirements
- Strong software engineering fundamentals and the ability to work across frontend, backend, and data systems.
- Proficiency in Python and a modern web stack such as TypeScript and React, or comparable tools.
- Experience building internal or user-facing products end-to-end, from understanding workflows through shipping and improvement.
- Sound judgment about APIs, data models, and production systems, including reliability and debuggability.
- Ability to turn ambiguous quality problems into useful interfaces, automation, and measurable checks.
- Clear communication and comfort collaborating with research and quality teams.
- Preferred: experience with data review, annotation, evals, benchmarks, ML workflows, agent traces, graders, reward signals, RL training data, dashboards, observability tools, or complex datasets and pipelines.
Benefits
- Full-time employment with offices in San Francisco and Singapore, plus remote work for candidates able to overlap 70-80% with either time zone.
- Support for relocation and visas for strong full-time candidates to the US or Singapore.
- 100% covered medical, dental, and vision insurance through Blue Shield of California for US employees.
- Lunch and dinner for in-office employees.
- Company-wide holiday break from Christmas Eve through New Year's Day, in addition to PTO and paid holidays.
- Equinox membership, 401(k), and commuter benefits for US employees.
- Unlimited* access to ChatGPT, Claude Code, Cursor, and similar tools.
- Hiring process includes two technical interviews and a 2-3 day work trial.
Tech Stack
Categories
About HUD
HUD builds infrastructure for generating reinforcement-learning training data and evaluations for frontier AI agents, plus a marketplace where labs can buy and sell these assets. Its platform is used by frontier labs, Fortune 500 companies, and startups to create RL environments and post‑training datasets for RFT. Founded in 2025 and based in San Francisco, the company is privately held and a Y Combinator W25 alum.