GrepJob
Anthropic

Staff + Senior Software Engineer, Inference

Anthropic
Apply
about 4 hours ago
Seattle, WA, USA +2 moreSenior / Staff+
H1B Sponsor

Base Salary

$320k - $485k/yr

Responsibilities

  • Design, build, and maintain distributed systems for serving Claude.
  • Develop intelligent request routing and load balancing systems.
  • Maximize compute efficiency through autoscaling and orchestration.
  • Build production-grade deployment pipelines for new models.
  • Provide high-performance inference infrastructure for researchers.
  • Integrate new AI accelerator platforms and support new model architectures.
  • Use observability data to improve performance based on production workloads.

Requirements

  • Significant software engineering experience, particularly with distributed systems.
  • Results-oriented with a bias towards flexibility and impact.
  • Willingness to take on tasks outside of your job description.
  • Enjoy pair programming.
  • Desire to learn about machine learning systems and infrastructure.
  • Thrive in environments where technical excellence drives business results.
  • Care about the societal impacts of your work.

Benefits

  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.
  • Collaborative office space.