Member of Technical Staff - Model Serving / API Backend Engineer
Black Forest Labsabout 6 hours ago
Base Salary
$180k - $300k/yr
Responsibilities
- Turn research checkpoints into production-ready inference services.
- Design and maintain high-performance APIs serving millions of requests.
- Optimize inference latency and throughput across GPU infrastructure.
- Build scalable serving architectures that handle unpredictable traffic.
- Improve reliability, monitoring, and observability across model-serving systems.
- Prototype and ship demos that showcase new capabilities in days, not weeks.
- Collaborate closely with researchers to move from idea to live endpoint rapidly.
Requirements
- Experience building and operating systems at meaningful scale.
- Strong judgment around performance, reliability, and cost trade-offs.
- Experience scaling APIs or ML systems under load.
- Comfort working in fast-moving, research-adjacent environments.
- Ownership from system design through debugging and deployment.
- Experience with ML inference services in production.
- Familiarity with designing scalable API architectures with async processing.
- Knowledge of optimizing GPU workloads and managing distributed systems.
Benefits
- Flexible work arrangements with options for remote work and in-person collaboration.
- Coverage of reasonable travel costs for in-person meetings.
- A collaborative and supportive team culture grounded in shared values.