about 4 hours ago
Base Salary
$320k - $485k/yr
Responsibilities
- Design, build, and own backend services for Claude across multiple cloud service providers.
- Collaborate with internal teams and cloud partners to establish the full serving stack on new platforms.
- Develop CI/CD automation systems for reliable model version deployment.
- Create interfaces and tooling abstractions for cost-effective inference management.
- Contribute to capacity planning and workload routing strategies.
- Analyze observability data to identify and remediate performance issues.
Requirements
- Significant software engineering experience with large-scale distributed systems.
- Experience building or operating services on major cloud platforms like AWS, GCP, or Azure.
- Curiosity about LLM serving; prior inference or ML experience is not required.
- Ability to thrive in cross-functional collaboration.
- Experience working with external partners to align goals.
- Fast learner who can quickly adapt to new technologies.
- Highly autonomous and takes ownership of problems end-to-end.
Benefits
- Competitive compensation and benefits.
- Optional equity donation matching.
- Generous vacation and parental leave.
- Flexible working hours.
- Collaborative office space.