CoreWeave

Software Engineer, Inference AI/ML

CoreWeave
Apply
4 months ago
Bellevue, WA, USA or Sunnyvale, CA, USAEntry Level
H1B Sponsor

Base Salary

$92k - $135k/yr

Responsibilities

  • Implement well-scoped features and fixes in Python, Go, or C++ for model-serving services.
  • Write tests, code comments, and short design documents and participate in code reviews.
  • Add basic metrics and dashboards and assist with alarms and runbooks.
  • Follow on-call runbooks and learn incident response through a guided rotation.
  • Contribute to performance experiments involving request batching, concurrency, and caching.

Requirements

  • BS/MS in computer science, electrical engineering, or a related field, or equivalent practical experience.
  • Foundational knowledge of data structures, algorithms, and networked services.
  • Experience with Python or Go; C++ is a plus.
  • Linux fundamentals and basic Git and CI knowledge.
  • Exposure to containers and Kubernetes through coursework or projects.
  • Curiosity about GPU inference concepts such as micro-batching, KV cache, and streaming.
  • Internship or project experience deploying a microservice or ML inference demo is preferred.
  • Coursework or research using PyTorch or TensorFlow is preferred; simple CUDA projects are a plus.
  • Familiarity with Grafana, Prometheus, OpenTelemetry, or similar tooling is preferred.
  • Applicants must meet applicable U.S. export-control access or authorization requirements.

Benefits

  • Medical, dental, and vision insurance fully paid by CoreWeave
  • Company-paid life insurance and voluntary supplemental life insurance
  • Short- and long-term disability insurance
  • Flexible Spending Account and Health Savings Account
  • Tuition reimbursement
  • Employee Stock Purchase Program
  • Mental wellness benefits through Spring Health
  • Family-forming support through Carrot
  • Paid parental leave
  • Flexible childcare support through Kinside
  • 401(k) with employer match
  • Flexible PTO
  • Catered lunch at office and data center locations
  • Hybrid work environment prioritized; remote work may be considered for candidates more than 30 miles from an office
  • Onboarding at a company hub within the first month and quarterly team gatherings

Tech Stack

C++GitGoGrafanaKubernetesLinuxPrometheusPythonPyTorchTensorFlow
CoreWeave

About CoreWeave

1,001-5,000 employees

CoreWeave is the Essential Cloud for AI. CoreWeave is a cloud purpose-built for scaling, supporting, and accelerating GenAI. We’re a comprehensive platform and strategic partner designed to tackle today—and tomorrow’s—challenges of deploying AI at scale. We manage the complexities of AI growth to make supercomputing accessible and push the limits of what’s possible. Our teams create modern solutions to support modern technology. Get the premier choice for working with GenAI workloads.