Base Salary
$131k - $192k/yr
Responsibilities
- Build and operate an in-house Apache Spark platform spanning runtime, scheduler, reliability, and user-facing tooling
- Drive multi-tenant scheduling, executor bin-packing, and cost-aware placement for multiple consumer teams
- Own cluster lifecycle automation for provisioning, upgrades, capacity changes, and node-failure handling
- Build observability and incident automation to make the platform debuggable and sustainable
- Partner with senior engineers on shuffle, runtime, and architecture work
- Collaborate with platform consumers across the company
Requirements
- B.S., M.S., or PhD in Computer Science or equivalent experience
- 24+ years of industry experience operating production distributed systems
- Experience operating Apache Spark at scale on Amazon EMR, Databricks, or an in-house deployment, especially platform operations
- Hands-on experience operating production systems on Kubernetes, including controllers, operators, custom resources, and multi-tenant cluster failure modes
- Familiarity with batch or big-data schedulers such as YuniKorn, Volcano, or Kueue, and/or the Spark-on-Kubernetes operator
- Familiarity with observability stacks, distributed tracing, structured logging, SLOs, and SLIs
- Cloud experience, preferably AWS, including VPC networking, instance lifecycle, spot or preemptible markets, and autoscaling primitives
- Professional experience with Python, Go, Scala, or Java and fluency with SQL
- Located in or willing to relocate to the Bay Area, Seattle, or New York City
Benefits
- 401(k) plan with employer matching
- 16 weeks of paid parental leave
- Wellness benefits
- Commuter benefits match
- Paid time off and paid sick leave
- Medical, dental, and vision benefits
- 11 paid holidays
- Disability and basic life insurance
- Family-forming assistance
- Mental health program
- Flexible paid time off for salaried roles
- Hybrid position requiring location in San Francisco, Sunnyvale, Seattle, or New York City
Tech Stack
About DoorDash
At DoorDash, our mission to empower local economies shapes how our team members move quickly and always learn and reiterate to support merchants, Dashers and the communities we serve. We are a technology and logistics company that started with door-to-door delivery, and we are looking for team members who can help us go from a company that is known for delivering food to a company that people turn to for any and all goods. DoorDash is growing rapidly and changing constantly, which gives our team members the opportunity to share their unique perspectives, solve new challenges, and own their careers. Our leaders seek the truth and welcome big, hairy, audacious questions. We are grounded in our company values, and we make intentional decisions that are both logical and display empathy for our range of users—from Dashers to Merchants to Customers.