3 hours ago
Base Salary
$500k - $850k/yr
Responsibilities
- Design, build, and operate feedback and data collection interfaces for human annotators, domain experts, and internal researchers.
- Build and maintain backend services, APIs, and data pipelines that route model samples to humans and return structured feedback for training.
- Own the reliability, latency, and usability of systems operating continuously against live model endpoints.
- Partner with RL researchers to translate changing data needs into collection campaigns and supporting tools.
- Build dashboards, monitoring, and inspection tools for researchers to evaluate data quality and throughput.
- Identify and remove bottlenecks between desired data collection and inclusion in the training mix.
Requirements
- Strong full-stack engineering skills with production experience in TypeScript/React on the frontend and Python on the backend.
- Experience designing and operating backend services and data pipelines relied upon by other teams.
- Track record of owning projects end to end from ambiguous briefs through production.
- Ability to work directly with technical stakeholders whose needs change frequently and exercise judgment about what to build.
- Effective use of AI tools in day-to-day work and consideration of the societal impacts of the work.
- Preferred: experience with annotation, labeling, evaluation, human-in-the-loop data tooling, RLHF, preference data, researcher-facing tools, data collection experiments, crowdworker or expert vendor platforms, and LLM training and evaluation.
Benefits
- Hybrid work with staff expected to be in an office at least 25% of the time.
- Visa sponsorship may be available, with immigration lawyer support.
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
Tech Stack
Categories
Data EngineeringFull Stack
About Anthropic
We're an AI research company that builds reliable, interpretable, and steerable AI systems. Our first product is Claude, an AI assistant for tasks at any scale. Our research interests span multiple areas including natural language, human feedback, scaling laws, reinforcement learning, code generation, and interpretability.