GrepJob
CoreWeave

Senior Software Engineer II, Inference

CoreWeave
Apply
5 days ago
Bellevue, WA, USA or Sunnyvale, CA, USASenior / Mid Level

Base Salary

$165k - $242k/yr

Responsibilities

  • Lead design reviews and drive architecture within the team.
  • Define and own SLIs/SLOs to improve reliability.
  • Implement advanced optimizations and quantify their impact.
  • Strengthen incident posture through capacity planning and autoscaling.
  • Mentor IC1/IC2 engineers and elevate coding/testing standards.
  • Own an area spanning multiple services and teams.

Requirements

  • 5-8 years of experience building distributed systems or cloud services.
  • Strong coding skills in Python or Go; C++ is a plus.
  • Experience optimizing end-to-end ML system performance.
  • Hands-on experience with Kubernetes at production scale.
  • Practical knowledge of inference internals like batching and caching.
  • Proven track record of improving service reliability through metrics.

Benefits

  • 100% paid medical, dental, and vision insurance.
  • Company-paid life insurance and short/long-term disability insurance.
  • Tuition reimbursement and participation in Employee Stock Purchase Program.
  • Flexible PTO and paid parental leave.
  • Catered lunch each day in office locations.
  • 401(k) with a generous employer match.

Tech Stack

C++GoGrafanaKubernetesPrometheusPython

Categories

AI & MLBackendData Engineering