2 months ago
London, United KingdomStaff+
Responsibilities
- Design, build, and maintain distributed systems serving Claude to millions of users.
- Develop resilient systems, intelligent request routing, load balancing, and traffic management across thousands of accelerators.
- Maximize compute efficiency through autoscaling and orchestration of production, research, and experimental workloads.
- Build and operate production-grade deployment pipelines for releasing new models.
- Provide high-performance inference infrastructure for next-generation model development.
- Integrate new AI accelerator platforms and support inference for new model architectures.
- Analyze observability data, tune production performance, and manage multi-region deployments and geographic routing.
Requirements
- Proficiency in Python or Rust.
- Experience building and operating distributed systems in production.
- Working knowledge of containerized infrastructure such as Kubernetes and at least one major cloud platform: AWS, GCP, or Azure.
- Significant experience with high-performance, large-scale distributed systems is preferred.
- Experience implementing and deploying machine learning systems at scale is preferred.
- Experience with load balancing, request routing, or traffic management is preferred.
- Familiarity with LLM inference optimization, batching, and caching strategies is preferred.
- Deep experience operating Kubernetes and cloud infrastructure at scale is preferred.
- Experience with GPUs, TPUs, or emerging AI accelerator hardware is preferred.
- Bachelor’s degree in a relevant field, or an equivalent combination of education, training, and/or experience.
- Strong communication, flexibility, learning orientation, and concern for the societal impacts of the work.
Benefits
- Hybrid policy requiring staff to work from an office at least 25% of the time, with some roles requiring more office time.
- Visa sponsorship is available, with immigration-lawyer support, subject to role and candidate eligibility.
- Competitive compensation, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
- Applications are reviewed on a rolling basis with no stated deadline.
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.