16 days ago
Dublin, IrelandStaff+
Responsibilities
- Design intelligent routing algorithms to optimize request distribution across thousands of accelerators.
- Build autoscaling systems that match compute supply with demand across production, research, and experimental workloads.
- Develop production-grade deployment pipelines for releasing new models to millions of users.
- Integrate new AI accelerator platforms and support new model architectures.
- Improve inference features such as structured sampling and prompt caching.
- Analyze observability data to tune performance using real-world production workloads.
- Manage multi-region deployments and geographic routing for global customers.
- Identify and address infrastructure blockers through end-to-end software engineering.
Requirements
- Significant software engineering experience, particularly with distributed systems.
- Experience with high-performance, large-scale distributed systems.
- Experience implementing and deploying machine learning systems at scale.
- Familiarity with performance optimization, large-scale service orchestration, intelligent request routing, load balancing, traffic management, or related systems.
- Familiarity with LLM inference optimization, batching, and caching strategies is encouraged but not required.
- Experience with Kubernetes and cloud infrastructure such as AWS or GCP is valuable.
- Proficiency or experience with Python or Rust is valuable.
- Ability to work flexibly, take ownership beyond the formal job description, and communicate effectively in a collaborative research environment.
- Bachelor’s degree or an equivalent combination of education, training, and/or experience in a relevant field.
Benefits
- Annual compensation range of €295.000—€355.000 EUR.
- Visa sponsorship is offered, with reasonable efforts made if an offer is extended and support from an immigration lawyer.
- Hybrid policy requiring staff to work from an office at least 25% of the time, with some roles requiring more office time.
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and collaborative office space.
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.