Staff Software Engineer, Inference
Anthropic
24 days ago
London, United Kingdom
Staff+
H1B Sponsor
Responsibilities
- Build and maintain systems that serve Claude to millions of users.
- Optimize compute efficiency to support customer growth.
- Enable breakthrough AI research with high-performance inference infrastructure.
- Design intelligent routing algorithms for request distribution.
- Autoscale compute fleets to match supply with demand.
- Build production-grade deployment pipelines for new models.
- Integrate new AI accelerator platforms.
- Analyze observability data to tune performance.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Familiarity with performance optimization and large-scale service orchestration.
- Experience with load balancing, request routing, or traffic management systems.
- Knowledge of Kubernetes and cloud infrastructure (AWS, GCP) is preferred.
- Proficiency in Python or Rust is encouraged.
- Bachelor's degree in a related field or equivalent experience.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
AWSGoogle Cloud PlatformKubernetesPythonRust
Categories
AI & MLBackendData Engineering