Senior Software Engineer - Distributed Data Systems
Databricksover 1 year ago
Base Salary
$166k - $225k/yr
Responsibilities
- Build next-generation distributed data storage and processing systems for diverse workloads ranging from ETL to data science.
- Develop and improve Apache Spark and other big data processing frameworks.
- Build reliable, high-performance data-plane storage services and client libraries for cloud storage backends.
- Develop Delta Lake storage management capabilities, including ACID transactions and time travel.
- Build systems to orchestrate and operate tens of thousands of data pipelines.
- Improve query optimizers and execution engines for speed, scalability, and robustness.
Requirements
- Bachelor’s degree or higher in Computer Science or a related technical field, or equivalent practical experience.
- At least five years of production-level experience with Java, Scala, or C++.
- Strong foundation in algorithms and data structures and their real-world applications.
- Experience with distributed systems, databases, and big data systems such as Apache Spark and Hadoop.
- Ability to work toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and impact.
Benefits
- Comprehensive employee benefits and perks, with details varying by region.
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).