Staff Software Engineer - Distributed Data Systems
Databricksover 1 year ago
Base Salary
$192k - $260k/yr
Responsibilities
- Build next-generation distributed data storage and processing systems for diverse workloads ranging from ETL to data science.
- Develop and improve Apache Spark, a large-scale open-source big data framework.
- Deliver reliable, high-performance data-plane storage services and client libraries for cloud storage backends.
- Develop Delta Lake storage management capabilities, including ACID transactions and time travel.
- Build Delta Pipelines functionality for deploying, testing, upgrading, and operating large numbers of data pipelines.
- Develop query optimizers and execution engines that are fast, scalable, tuning-free, and robust.
Requirements
- Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience.
- Optional MS or PhD in databases or distributed systems.
- 8+ years of production-level experience with Java, Scala, or C++.
- Strong foundation in algorithms and data structures and their real-world applications.
- Experience with distributed systems, databases, and big data systems, including Apache Spark and Hadoop.
- Ability to work toward a multi-year vision with incremental deliverables and focus on customer value.
Benefits
- Comprehensive employee benefits and perks are offered; details vary by region and are available at the Databricks benefits site.
Tech Stack
Categories
BackendData Engineering
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).