3 months ago
Canada (city not specified)Senior / Staff+
Responsibilities
- Design, build, and maintain distributed systems serving Claude to millions of users worldwide.
- Develop resilient systems that adapt in real time to real-world events.
- Build request routing, load balancing, and traffic management systems across thousands of accelerators.
- Maximize fleet compute efficiency through autoscaling and orchestration of production, research, and experimental workloads.
- Build and operate production-grade deployment pipelines for releasing new models.
- Provide high-performance inference infrastructure for researchers developing next-generation models.
- Integrate new AI accelerator platforms and support inference for new model architectures.
- Analyze observability data to tune performance based on production workloads.
- Manage multi-region deployments and geographic routing for global customers.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Experience with high-performance, large-scale distributed systems is preferred.
- Experience implementing and deploying machine learning systems at scale is preferred.
- Experience with load balancing, request routing, or traffic management systems is preferred.
- Familiarity with LLM inference optimization, batching, and caching strategies is preferred.
- Experience with Kubernetes and cloud infrastructure such as AWS, GCP, or Azure is preferred.
- Proficiency in Python or Rust is preferred.
- A bachelor’s degree or equivalent combination of education, training, and/or experience is required.
- A relevant field of study demonstrated through coursework, training, or professional experience is required.
Benefits
- Competitive compensation and benefits, with equity donation matching, vacation and parental leave, flexible working hours, and office space.
- Hybrid policy requiring staff to work from an office at least 25% of the time.
- Visa sponsorship may be available, with immigration-lawyer support.
- Applications are reviewed on a rolling basis with no stated deadline.
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.