Senior Software Engineer - Distributed Data Systems
Databricks2 months ago
Base Salary
$158k - $214k/yr
Responsibilities
- Build distributed data storage and processing systems for ETL, data science, and other diverse workloads.
- Develop and improve Apache Spark and other big data processing frameworks.
- Build reliable, high-performance data storage services and client libraries for cloud storage backends.
- Develop Delta Lake storage management capabilities, including transactional and time-travel abstractions.
- Build systems for orchestrating, deploying, testing, and upgrading large numbers of data pipelines.
- Develop query optimizers and execution engines focused on performance, scalability, and robustness.
- Deliver incremental work toward a multi-year technical vision and customer impact.
Requirements
- Bachelor’s degree or higher in Computer Science, a related technical field, or equivalent practical experience.
- At least 5 years of production-level experience with Java, Scala, or C++.
- Strong foundation in algorithms and data structures and their practical applications.
- Experience with distributed systems, databases, and big data systems such as Apache Spark and Hadoop.
- Ability to work toward a multi-year vision through incremental deliverables.
- Motivation to deliver customer value and measurable impact.
Benefits
- Comprehensive employee benefits and perks, with details varying by region.
- Potential eligibility for an annual performance bonus and equity.
- Local pay range provided for the role; work arrangement and location requirements are not specified.
Tech Stack
Categories
BackendData Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.