Infra Engineer - API
General Intuition & Medalabout 3 hours ago
New York, NY, USAMid Level / Senior
Base Salary
$250k - $400k/yr
Responsibilities
- Own the video streaming protocol for efficient frame reception and routing.
- Manage the runtime layer of the API, including stateful request routing and inference orchestration.
- Scale Kubernetes footprint across regions and lead new deployments.
- Develop a GPU hosting strategy to scale from dozens to thousands of GPUs.
- Drive latency and throughput improvements and manage the inference-performance backlog.
- Collaborate with product engineering on developer-facing reliability and uptime.
Requirements
- Proven experience scaling high-traffic, low-latency APIs in production.
- Deep knowledge of Kubernetes, including multi-region deployments.
- Familiarity with SLOs and capacity planning.
- Strong ownership instinct with experience managing systems end-to-end.
- Bonus points for experience with streaming video/audio models and GPU fleet scaling.
Benefits
- Competitive salary and meaningful equity.
- Comprehensive medical, dental, and vision coverage.
- 401(k) plan.
- Wellhub membership for fitness and wellness.
- Mental health support through Spring Health and Headspace.
- Fertility and maternal health benefits.
- Paid parental leave.
- Generous PTO, 11 paid company holidays, and paid sick time.
- Daily meals and commuter benefits at NYC HQ.
- Learning and development stipend.