Anthropic

Staff+ Software Engineer, ML Inference Path

Anthropic
Apply
5 hours ago

Base Salary

$320k - $485k/yr

Responsibilities

  • Design and build scalable ML infrastructure for real-time safety deployments across classifier and model systems.
  • Build monitoring and observability tools for classifier performance, data quality, and system health.
  • Productionize safety research by translating experimental techniques into robust, scalable systems.
  • Optimize inference latency and throughput for real-time safety evaluations while maintaining reliability.
  • Implement automated testing, deployment, rollback, A/B testing, and experimentation infrastructure for production ML models.
  • Collaborate with Safeguards, Security, Alignment, and research teams to deliver safety-focused infrastructure.
  • Develop internal tools and frameworks that accelerate safety research and deployment.

Requirements

  • Proficiency in Python and experience with ML frameworks such as PyTorch, TensorFlow, or JAX.
  • Understanding of distributed systems and experience building high-throughput, low-latency systems.
  • Experience building automated or self-service deployment pipelines and evaluation infrastructure for independent model and classifier rollouts.
  • Experience implementing A/B testing frameworks and experimentation infrastructure for ML systems.
  • Bachelor’s degree or an equivalent combination of education, training, and/or experience in a relevant field, as demonstrated through coursework, training, or professional experience.
  • Strong candidates may have 5+ years building production ML infrastructure, experience with large language models and transformer architectures, ML model monitoring and data-drift alerting, trust and safety or fraud-prevention experience, and knowledge of privacy-preserving ML and compliance requirements.

Benefits

  • Annual compensation range is $320,000–$485,000 USD.
  • Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
  • Hybrid policy expects staff to work from an office at least 25% of the time, with some roles requiring more office time.
  • Anthropic sponsors visas and states that if it makes an offer, it will make every reasonable effort to obtain a visa, with immigration-lawyer support.

Tech Stack

PythonPyTorchTensorFlow
Anthropic

About Anthropic

5,001-10,000 employees

Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.

Contact me