Staff Software Engineer - Database Engine Internals
Databricksover 1 year ago
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement next-generation query engine and structured storage systems.
- Work on query compilation and optimization.
- Develop distributed query execution and scheduling systems.
- Develop vectorized execution engines.
- Address data security and resource management.
- Build transaction coordination systems.
- Design efficient storage structures, including encodings and indexes.
- Develop automatic physical data optimization capabilities.
Requirements
- Passion for database systems, storage systems, distributed systems, language design, or performance optimization.
- Experience working toward a multi-year vision with incremental deliverables.
- Motivation to deliver customer value and impact.
- Eight or more years of experience working in a related system is preferred.
- A PhD in databases or distributed systems is optional.
Benefits
- Comprehensive benefits and perks are offered, with details varying by region.
- The role is a non-commissionable position with a stated local base salary range.
Tech Stack
Apache SparkMLflow
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.