1 day ago
Dublin, IrelandSenior
Responsibilities
- Design intelligent routing algorithms to optimize request distribution across thousands of accelerators.
- Build autoscaling systems that match compute supply with production, research, and experimental demand.
- Develop production-grade deployment pipelines for releasing new models to millions of users.
- Integrate new AI accelerator platforms and support new model architectures.
- Implement inference features such as structured sampling and prompt caching.
- Analyze observability data to tune performance based on real-world production workloads.
- Manage multi-region deployments and geographic routing for global customers.
- Build and maintain compute-agnostic inference systems spanning request routing through fleet-wide orchestration.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Experience with load balancing, request routing, or traffic management systems.
- Experience with LLM inference optimization, batching, and caching strategies.
- Experience with Kubernetes and cloud infrastructure such as AWS and GCP.
- Experience with Python or Rust is valued.
- Bachelor’s degree or an equivalent combination of education, training, and/or experience.
- Relevant field of study demonstrated through coursework, training, or professional experience.
- Results-oriented approach, flexibility, willingness to take on work beyond the formal job description, and interest in machine learning systems and infrastructure.
Benefits
- Annual compensation is €235.000—€295.000 EUR.
- Staff are expected to work from one of the company’s offices at least 25% of the time, with some roles requiring more office time.
- Anthropic sponsors visas and will make every reasonable effort to obtain a visa if an offer is made, though sponsorship is not successful for every role or candidate.
- Benefits include competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.