Senior Staff Software Engineer - Lakeflow Pipelines Datasets
Databricks5 months ago
Base Salary
$229k - $314k/yr
Responsibilities
- Architect and deliver a scalable, fault-tolerant platform for declarative pipelines and materialized views.
- Translate ambiguous large-scale technical challenges into incremental execution plans suitable for exabyte-scale systems.
- Bring research and internal R&D ideas into production systems that solve customer problems.
- Lead performance diagnosis, low-level debugging, and optimization on large production clusters.
- Shape product direction and own technical strategy from design through delivery.
- Drive complex, multi-team technical initiatives with sustained coordination and technical judgment.
Requirements
- 10+ years of experience building, operating, and evolving large-scale distributed systems in production.
- Deep expertise in database internals, storage systems, distributed computing, streaming systems, language/API design, or performance engineering.
- Experience executing a multi-year technical vision through incremental milestones.
- Strong algorithmic foundations and practical engineering judgment.
- Experience building cross-team alignment and driving initiatives from conception through customer adoption.
- BS, MS, or PhD in Computer Science or a related field, or equivalent depth of experience.
Benefits
- Comprehensive employee benefits and perks, with details varying by region.
Tech Stack
Apache SparkMLflow
Categories
BackendData Engineering
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).