Base Salary
$131k - $192k/yr
Responsibilities
- Set the multi-year technical direction for the in-house Spark-on-Kubernetes platform.
- Own distributed-systems architecture across the runtime, shuffle service, scheduler, performance, and reliability layers.
- Partner with the Engineering Manager on technical roadmaps, hiring, interview design, and team structure.
- Mentor engineers through design reviews and raise the quality bar for shipped systems.
- Represent Spark Platform in cross-team architecture forums and influence how data, analytics, and ML workloads use the platform.
Requirements
- Bachelor’s, master’s, or PhD in Computer Science or equivalent.
- 6+ years of industry experience designing and operating distributed systems at scale.
- Deep hands-on Apache Spark experience covering internals, query execution, shuffle, and the executor/driver model at platform scale.
- Experience operating Spark on Amazon EMR, Databricks, or an in-house deployment, with emphasis on platform operations.
- Production experience with remote or external shuffle systems, batch or big-data schedulers, or observability and SRE patterns for distributed compute platforms.
- Strong production Kubernetes experience, including operator patterns, executor pod lifecycle, network topology, and multi-tenant failure modes.
- Familiarity with Apache Iceberg or Delta Lake and query or SQL engines that read them.
- Track record of technical leadership, mentoring, setting direction, and partnering with management on roadmaps and hiring.
- Professional experience with Scala, Java, Python, or Go, plus strong SQL.
- Located in or willing to relocate to the Bay Area, Seattle, or New York City.
Benefits
- Hybrid position requiring location in San Francisco, Sunnyvale, Seattle, or New York City, or relocation to the Bay Area, Seattle, or NYC.
- Comprehensive medical, dental, and vision benefits.
- 401(k) plan with employer matching.
- 16 weeks of paid parental leave.
- Flexible paid time off and 80 hours of paid sick time annually for salaried employees.
- Wellness, commuter benefits match, and mental health benefits.
- 11 paid holidays, disability insurance, basic life insurance, and family-forming assistance.
- Equity grant opportunities in addition to base salary.
Tech Stack
About DoorDash
At DoorDash, our mission to empower local economies shapes how our team members move quickly and always learn and reiterate to support merchants, Dashers and the communities we serve. We are a technology and logistics company that started with door-to-door delivery, and we are looking for team members who can help us go from a company that is known for delivering food to a company that people turn to for any and all goods. DoorDash is growing rapidly and changing constantly, which gives our team members the opportunity to share their unique perspectives, solve new challenges, and own their careers. Our leaders seek the truth and welcome big, hairy, audacious questions. We are grounded in our company values, and we make intentional decisions that are both logical and display empathy for our range of users—from Dashers to Merchants to Customers.