Sr. Staff Software Engineer - Managed Tables
Databricks5 months ago
Base Salary
$229k - $314k/yr
Responsibilities
- Design and implement enterprise-grade autonomous analytical data systems for Managed Tables.
- Build scalable, highly available, and interoperable Managed Tables architecture.
- Develop storage lifecycle and background optimization capabilities through Predictive Optimization.
- Create efficient storage structures and innovations for machine-learning workloads.
- Contribute to data-format and catalog-interface unification and ecosystem interoperability.
- Perform low-level systems debugging, performance measurement, and optimization on large production clusters.
- Design architectures, influence product roadmaps, and own new technical projects.
- Introduce tools that improve service automation and operability.
- Prevent and investigate production issues using deep systems experience.
- Plan and lead complex technical projects spanning multiple internal teams.
- Mentor and up-level engineers on the team.
Requirements
- 15+ years of industry experience building and supporting large-scale distributed systems.
- Passion for database systems, storage systems, distributed systems, language design, or performance optimization.
- Experience working toward a multi-year vision with incremental deliverables.
- Strong foundation in algorithms and data structures and their real-world applications.
- Experience driving company initiatives toward customer satisfaction.
- BS, MS, or PhD in Computer Science or a related major, or equivalent experience.
- Motivation to deliver customer value and impact.
Benefits
- Comprehensive employee benefits and perks are offered, with region-specific details available through Databricks.
- Annual performance bonus and equity may be included in the total compensation package.
Tech Stack
Apache SparkMLflow
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.