CoreWeave

Software Engineer, Inference AI/ML

CoreWeave
Apply
5 months ago
Bellevue, WA, USA or Sunnyvale, CA, USAEntry Level
H1B sponsor

Base Salary

$92k - $135k/yr

Responsibilities

  • Implement well-scoped features and fixes in Python, Go, or C++ for model-serving services.
  • Write tests, code comments, and short design documents and participate in code reviews.
  • Add basic metrics and dashboards and assist with alarms and runbooks.
  • Follow on-call runbooks and learn incident response through a guided rotation.
  • Contribute to performance experiments involving request batching, concurrency, and caching.

Requirements

  • BS/MS in computer science, electrical engineering, or a related field, or equivalent practical experience.
  • Foundational knowledge of data structures, algorithms, and networked services.
  • Experience with Python or Go; C++ is a plus.
  • Linux fundamentals and basic Git and CI knowledge.
  • Exposure to containers and Kubernetes through coursework or projects.
  • Curiosity about GPU inference concepts such as micro-batching, KV cache, and streaming.
  • Internship or project experience deploying a microservice or ML inference demo is preferred.
  • Coursework or research using PyTorch or TensorFlow is preferred; simple CUDA projects are a plus.
  • Familiarity with Grafana, Prometheus, OpenTelemetry, or similar tooling is preferred.
  • Applicants must meet applicable U.S. export-control access or authorization requirements.

Benefits

  • Medical, dental, and vision insurance fully paid by CoreWeave
  • Company-paid life insurance and voluntary supplemental life insurance
  • Short- and long-term disability insurance
  • Flexible Spending Account and Health Savings Account
  • Tuition reimbursement
  • Employee Stock Purchase Program
  • Mental wellness benefits through Spring Health
  • Family-forming support through Carrot
  • Paid parental leave
  • Flexible childcare support through Kinside
  • 401(k) with employer match
  • Flexible PTO
  • Catered lunch at office and data center locations
  • Hybrid work environment prioritized; remote work may be considered for candidates more than 30 miles from an office
  • Onboarding at a company hub within the first month and quarterly team gatherings

Tech Stack

C++GitGoGrafanaKubernetesLinuxPrometheusPythonPyTorchTensorFlow
CoreWeave

About CoreWeave

1,001-5,000 employees

CoreWeave provides a GPU-accelerated cloud for AI training and inference, VFX, and rendering, with bare-metal instances, Kubernetes orchestration, and managed services to scale workloads. It sells on-demand and reserved capacity to AI labs, startups, and enterprises, and offers SaaS tools and hands-on support for deployment. Founded in 2017 and headquartered in New York, it is publicly traded on Nasdaq under the ticker CRWV.

Contact me