2 months ago
Base Salary
$500k - $850k/yr
Responsibilities
- Design, build, and operate feedback and data collection interfaces for human annotators, domain experts, and internal researchers.
- Build and maintain backend services, APIs, and data pipelines that route model samples to humans and return structured feedback for training.
- Own the reliability, latency, and usability of systems operating continuously against live model endpoints.
- Partner with RL researchers to translate changing data needs into collection campaigns and supporting tools.
- Build dashboards, monitoring, and inspection tools for researchers to evaluate data quality and throughput.
- Identify and remove bottlenecks between desired data collection and inclusion in the training mix.
Requirements
- Strong full-stack engineering skills with production experience in TypeScript/React on the frontend and Python on the backend.
- Experience designing and operating backend services and data pipelines relied upon by other teams.
- Track record of owning projects end to end from ambiguous briefs through production.
- Ability to work directly with technical stakeholders whose needs change frequently and exercise judgment about what to build.
- Effective use of AI tools in day-to-day work and consideration of the societal impacts of the work.
- Preferred: experience with annotation, labeling, evaluation, human-in-the-loop data tooling, RLHF, preference data, researcher-facing tools, data collection experiments, crowdworker or expert vendor platforms, and LLM training and evaluation.
Benefits
- Hybrid work with staff expected to be in an office at least 25% of the time.
- Visa sponsorship may be available, with immigration lawyer support.
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
Tech Stack
Categories
Data EngineeringFull Stack
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.