Staff Software Engineer - Distributed Data Systems
Databricks17 days ago
Base Salary
$182k - $247k/yr
Responsibilities
- Build next-generation distributed data storage and processing systems for ETL, data science, and other workloads.
- Develop and improve Apache Spark and large-scale big data processing capabilities.
- Build reliable, high-performance storage services and client libraries for cloud storage backends such as AWS S3 and Azure Blob Store.
- Develop Delta Lake storage management capabilities, including scalable data lake, warehouse, and streaming abstractions.
- Improve Delta Pipelines for orchestrating, deploying, testing, and upgrading tens of thousands of data pipelines.
- Build query optimizers and execution engines focused on performance, scalability, and robustness.
- Work toward a multi-year technical vision while delivering incremental improvements and customer value.
Requirements
- Bachelor’s degree or higher in Computer Science or a related technical field, or equivalent practical experience.
- 8+ years of production-level experience with Java, Scala, or C++.
- Strong foundation in algorithms and data structures and their real-world applications.
- Experience with distributed systems, databases, and big data systems including Apache Spark and Hadoop.
- Ability to work toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and impact.
Benefits
- Databricks provides comprehensive benefits and perks, with specific offerings varying by region.
- The total compensation package may include an annual performance bonus, equity, and benefits.
Tech Stack
Categories
BackendData Engineering
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).