3 months ago
Base Salary
$131k - $192k/yr
Responsibilities
- Build and operate an in-house Apache Spark platform spanning runtime, scheduler, reliability, and user-facing tooling
- Drive multi-tenant scheduling, executor bin-packing, and cost-aware placement for multiple consumer teams
- Own cluster lifecycle automation for provisioning, upgrades, capacity changes, and node-failure handling
- Build observability and incident automation to make the platform debuggable and sustainable
- Partner with senior engineers on shuffle, runtime, and architecture work
- Collaborate with platform consumers across the company
Requirements
- B.S., M.S., or PhD in Computer Science or equivalent experience
- 24+ years of industry experience operating production distributed systems
- Experience operating Apache Spark at scale on Amazon EMR, Databricks, or an in-house deployment, especially platform operations
- Hands-on experience operating production systems on Kubernetes, including controllers, operators, custom resources, and multi-tenant cluster failure modes
- Familiarity with batch or big-data schedulers such as YuniKorn, Volcano, or Kueue, and/or the Spark-on-Kubernetes operator
- Familiarity with observability stacks, distributed tracing, structured logging, SLOs, and SLIs
- Cloud experience, preferably AWS, including VPC networking, instance lifecycle, spot or preemptible markets, and autoscaling primitives
- Professional experience with Python, Go, Scala, or Java and fluency with SQL
- Located in or willing to relocate to the Bay Area, Seattle, or New York City
Benefits
- 401(k) plan with employer matching
- 16 weeks of paid parental leave
- Wellness benefits
- Commuter benefits match
- Paid time off and paid sick leave
- Medical, dental, and vision benefits
- 11 paid holidays
- Disability and basic life insurance
- Family-forming assistance
- Mental health program
- Flexible paid time off for salaried roles
- Hybrid position requiring location in San Francisco, Sunnyvale, Seattle, or New York City
Tech Stack
About DoorDash
DoorDash builds a marketplace and logistics platform that connects consumers with local restaurants and retailers for on-demand delivery and pickup, powered by a network of independent Dashers. It earns through delivery fees, merchant commissions, advertising, DashPass subscriptions, and white-label fulfillment via DoorDash Drive. Founded in 2013 and headquartered in San Francisco, the public company operates across the U.S. and selected international markets, and also researches automation through DoorDash Labs.