Staff Software Engineer, Inference
Anthropic
4 months ago
Dublin, Ireland
Staff+
H1B Sponsor
Responsibilities
- Build and maintain systems that serve Claude to millions of users.
- Maximize compute efficiency to support customer growth.
- Enable breakthrough AI research with high-performance inference infrastructure.
- Tackle complex distributed systems challenges across multiple AI accelerators.
- Design intelligent routing algorithms for request distribution.
- Autoscale compute fleets to match supply with demand.
- Build production-grade deployment pipelines for new models.
- Integrate new AI accelerator platforms to maintain competitive advantage.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Familiarity with performance optimization and large-scale service orchestration.
- Experience with load balancing, request routing, or traffic management systems.
- Knowledge of LLM inference optimization and batching strategies is preferred.
- Experience with Kubernetes and cloud infrastructure (AWS, GCP) is a plus.
- Proficiency in Python or Rust is encouraged.
Benefits
- Competitive compensation and benefits package.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
AWSGoogle Cloud PlatformKubernetesPythonRust
Categories
AI & MLBackendDevOps