GrepJob
Anthropic

Staff + Senior Software Engineer, Inference Deployment

Anthropic
Apply
about 4 hours ago
Seattle, WA, USA +2 moreSenior / Staff+
H1B Sponsor

Base Salary

$320k - $485k/yr

Responsibilities

  • Own deployment orchestration for moving validated inference builds into production across various fleets.
  • Improve capacity-aware deployment scheduling to maximize throughput against constrained resources.
  • Extend deployment observability with dashboards and tools for tracking code in production.
  • Drive down cycle time from code merge to production with optimized pipeline architectures.
  • Optimize fleet rollout strategies for large-scale deployments with minimal disruption.
  • Evolve self-service model onboarding for continuous deployment without engineering involvement.
  • Collaborate with teams on validation, autoscaling, and model routing to integrate automation.

Requirements

  • Strong software engineering skills with experience in complex state machines and multi-stage pipelines.
  • Proficiency in Kubernetes-based deployments and container orchestration.
  • Experience in building deployment infrastructure shaped by resource constraints.
  • Track record of building automation that improves deployment velocity and reliability.
  • Comfort working across the stack from backend services to web UIs.
  • Strong communication skills for collaboration with engineers and infrastructure partners.

Benefits

  • Competitive compensation and benefits.
  • Optional equity donation matching.
  • Generous vacation and parental leave.
  • Flexible working hours.
  • Collaborative office space.

Categories

AI & MLData EngineeringDevOps