6 months ago
Dublin, IrelandStaff+
Responsibilities
- Design intelligent routing algorithms to optimize request distribution across thousands of accelerators.
- Autoscale compute fleets across production, research, and experimental workloads.
- Build production-grade deployment pipelines for releasing new models to millions of users.
- Integrate new AI accelerator platforms and support new model architectures.
- Develop inference features such as structured sampling and prompt caching.
- Analyze observability data to tune performance using real-world production workloads.
- Manage multi-region deployments and geographic routing for global customers.
- Identify and address infrastructure blockers while enabling breakthrough AI research.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Experience with high-performance, large-scale distributed systems and/or implementing and deploying machine learning systems at scale.
- Familiarity with performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing.
- Experience with load balancing, request routing, traffic management, LLM inference optimization, batching, caching, Kubernetes, cloud infrastructure, Python, or Rust is valued.
- A Bachelor's degree in a related field or equivalent experience is required.
- Candidates should demonstrate flexibility, impact orientation, technical excellence, collaboration, and awareness of the societal impacts of their work.
Benefits
- Annual compensation of €295,000–€355,000 EUR
- Hybrid policy requiring staff to work from an office at least 25% of the time
- Visa sponsorship with immigration-lawyer support
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.