Staff + Senior Software Engineer, Cloud Inference
Anthropic
23 days ago
New York, NY, USA +2 more
Senior / Staff+
H1B Sponsor
Base Salary
$300k - $485k/yr
Responsibilities
- Design and build infrastructure that serves Claude across multiple CSPs.
- Collaborate with CSP partner engineering teams to resolve operational issues.
- Design and evolve CI/CD automation systems for reliable model deployment.
- Create interfaces and tooling abstractions for cost-effective inference management.
- Contribute to capacity planning and autoscaling strategies.
- Optimize inference cost and performance across providers.
- Contribute to inference features that work consistently across platforms.
- Analyze observability data to identify performance bottlenecks and cost anomalies.
Requirements
- Significant software engineering experience in high-performance, large-scale distributed systems.
- Experience building or operating services on major cloud platforms (AWS, GCP, Azure).
- Strong interest in inference and cloud service operations.
- Ability to thrive in cross-functional collaboration.
- Fast learner with the ability to ramp up on new technologies quickly.
- Highly autonomous and self-driven with a bias toward high-impact work.
- Willingness to take on tasks outside of the job description.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.
Tech Stack
AWSAzureGoogle Cloud PlatformKubernetesPythonRust
Categories
AI & MLData ScienceDevOps