Staff Software Engineer - Distributed Data Systems
Databricksover 1 year ago
Base Salary
$192k - $260k/yr
Responsibilities
- Build distributed data storage and processing systems for diverse workloads ranging from ETL to data science.
- Develop and improve Apache Spark, cloud storage services and client libraries, Delta Lake, Delta Pipelines, query optimizers, and execution engines.
- Design software that provides high performance, scalability, resilience, and reliability across cloud hardware, networks, and operating systems.
- Help operate a large-scale platform processing exabytes of data per day across millions of virtual machines.
- Deliver incremental improvements toward a multi-year technical vision.
Requirements
- Bachelor’s degree in computer science or a related technical field, or equivalent practical experience.
- 8+ years of production-level experience in Java, Scala, or C++.
- Strong foundation in algorithms and data structures and their real-world applications.
- Experience with distributed systems, databases, and big data systems such as Apache Spark and Hadoop.
- Optional master’s or PhD in databases or distributed systems.
- Ability to work toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and impact.
Benefits
- Comprehensive employee benefits and perks, with region-specific details available through the benefits portal.
Tech Stack
Categories
BackendData Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.