16 hours ago
Seattle, WA, USA or San Francisco, CA, USASenior / Staff+
H1B sponsor
Base Salary
$320k - $485k/yr
Responsibilities
- Bring up inference for new model architectures and ship them to cloud platforms in lockstep with Anthropic’s first-party platform.
- Own platform-specific integrations for new inference features such as structured sampling and prompt caching.
- Identify and fix configuration drift, observability gaps, deployment differences, and other cross-platform inference issues at their source.
- Design, build, and operate CI/CD infrastructure for inference servers and load balancers across cloud platforms.
- Implement shadow traffic, performance baselines, throughput and latency checks, and correctness validation to catch regressions before production.
- Reduce merge-to-production cycle time by making validation faster, more parallel, and cost-effective on constrained accelerator pools.
- Analyze observability data across providers to identify performance bottlenecks, cost anomalies, and regressions, and drive remediation.
Requirements
- Strong interest in LLM serving; prior inference or ML experience is not required.
- Significant software engineering experience and a strong background in high-performance, large-scale distributed systems serving millions of users.
- A track record of building automation or test infrastructure that improved release velocity or reliability.
- Experience building or operating services on AWS, GCP, or Azure, with exposure to Kubernetes, Infrastructure as Code, or container orchestration.
- Ability to collaborate with internal teams and external partners, learn new technologies and provider ecosystems quickly, and own problems end-to-end.
- Preferred: experience with LLM inference optimization, batching, caching strategies, capacity-constrained scheduling, shared-resource test infrastructure, multi-region deployments, request routing, load balancing, global traffic management, and scaling infrastructure across cloud platforms.
- Preferred: proficiency in Python or Rust.
Benefits
- Annual base salary range of $320,000—$485,000 USD.
- Hybrid policy currently expects staff to work from an office at least 25% of the time, with some roles requiring more office time.
- Anthropic sponsors visas and will make every reasonable effort to obtain a visa if an offer is made, with immigration-lawyer support.
- Competitive benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and office collaboration space.
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.