Staff Software Engineer - Database Engine Internals
Databricks
about 1 year ago
San Francisco, CA, USA
Staff+
H1B Sponsor
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement next-generation query engines and storage systems.
- Work on query compilation and optimization.
- Develop distributed query execution and scheduling mechanisms.
- Enhance data security and resource management.
- Coordinate transaction processes.
- Create efficient storage structures, including encodings and indexes.
- Implement automatic physical data optimization.
Requirements
- Passion for database systems, storage systems, and performance optimization.
- Experience in working towards a multi-year vision with incremental deliverables.
- Motivated by delivering customer value and impact.
- 8+ years of experience in a related system is preferred.
- Optional: PhD in databases or distributed systems.
Tech Stack
Apache SparkDatabricksMLflow
Categories
AI & MLData EngineeringData ScienceSecurity