Staff Software Engineer, ML Serving Platform
DoorDash
6 months ago
New York, NY, USA +3 more
Staff+
H1B Sponsor
Base Salary
$131k - $192k/yr
Responsibilities
- Design serving systems that handle large, complex models with low latency.
- Operationalize modern inference optimizations for better user experience.
- Build abstractions that apply serving improvements across multiple workloads.
- Leverage and contribute to open-source serving ecosystems.
- Design autoscaling and scheduling across heterogeneous hardware.
- Collaborate with ML engineers, infrastructure teams, and external vendors.
- Establish metrics and processes to improve system reliability and maintainability.
Requirements
- 8+ years of engineering experience with large-scale ML serving systems.
- Deep familiarity with ML inference and serving ecosystems.
- Ability to leverage and extend open-source frameworks.
- Strong focus on reliability, performance, and security in production systems.
- Experience in collaborating effectively and mentoring peers.
Benefits
- Comprehensive benefits package including 401(k) with employer matching.
- 16 weeks of paid parental leave.
- Wellness benefits and commuter benefits match.
- Medical, dental, and vision benefits.
- Paid time off and paid sick leave.
Tech Stack
AWSAzureGoogle Cloud PlatformKubernetesPyTorchTensorFlow
Categories
AI & MLBackend