5 months ago
Bellevue, WA, USA or Sunnyvale, CA, USAMid Level / Senior
H1B sponsor
Base Salary
$139k - $204k/yr
Responsibilities
- Lead design reviews, drive team architecture, and decompose multi-service work into milestones
- Define and own SLIs and SLOs and ensure post-incident actions improve reliability release over release
- Implement and measure advanced optimizations such as micro-batch schedulers, speculative decoding, and KV-cache reuse
- Improve incident readiness through capacity planning, autoscaling, graceful degradation, rollback, and traffic-shift strategies
- Mentor IC1 and IC2 engineers, review cross-team designs, and raise coding and testing standards
- For IC4, own a platform area spanning multiple services and teams, such as request routing, adaptive scheduling, cost-per-token analytics, or GPU resource isolation
Requirements
- Approximately 3–5 years of industry experience for IC3 or 5–8 years for IC4 building distributed systems or cloud services
- Bachelor’s or Master’s degree in computer science, electrical engineering, or a related field, or equivalent practical experience
- Strong Python or Go programming skills; C++ is a plus
- Deep familiarity with networked systems and performance
- Production-scale Kubernetes experience
- Hands-on experience with CI/CD and observability stacks including Prometheus, Grafana, and OpenTelemetry
- Practical knowledge of inference internals including batching, caching, BF16/FP8 mixed precision, and streaming token delivery
- Track record of improving P95/P99 tail latency and service reliability through metrics-driven work
- Preferred contributions to vLLM, Triton, TensorRT-LLM, Ray Serve, or TorchServe
- Preferred experience with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect topologies
- Preferred experience leading multi-team initiatives or partnering with customers on mission-critical launches
Benefits
- Medical, dental, and vision insurance fully paid by CoreWeave
- Company-paid life insurance and voluntary supplemental life insurance
- Short- and long-term disability insurance
- Flexible Spending Account and Health Savings Account
- Tuition reimbursement
- Employee Stock Purchase Program eligibility
- Mental wellness benefits through Spring Health
- Family-forming support through Carrot
- Paid parental leave
- Flexible childcare support through Kinside
- 401(k) with employer match
- Flexible PTO
- Catered lunch at office and data center locations
- Hybrid work is prioritized; remote work may be considered for candidates more than 30 miles from an office
- New hires attend onboarding at a company hub within their first month; teams gather quarterly
Tech Stack
Categories
About CoreWeave
CoreWeave provides a GPU-accelerated cloud for AI training and inference, VFX, and rendering, with bare-metal instances, Kubernetes orchestration, and managed services to scale workloads. It sells on-demand and reserved capacity to AI labs, startups, and enterprises, and offers SaaS tools and hands-on support for deployment. Founded in 2017 and headquartered in New York, it is publicly traded on Nasdaq under the ticker CRWV.