Staff Software Engineer - Data Platform
Databricks2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and operate the cross-company Data Intelligence Platform containing business and product metrics.
- Develop tooling and infrastructure to run Databricks at scale across multiple clouds, geographies, and deployment types.
- Build CI/CD processes, pipeline test frameworks, data-quality tooling, and infrastructure-as-code solutions.
- Build reliable data pipelines using Databricks, partner products, and open-source tools.
- Provide technical leadership on architecture, product vision, and long-term engineering requirements.
- Mentor and develop engineers and represent Databricks at academic and industrial conferences and events.
Requirements
- BS, MS, or PhD in Computer Science or a related major, or equivalent experience.
- 10+ years of industry experience building and operating large-scale distributed systems.
- 4+ years of experience providing technical leadership on planet-scale production data systems.
- Experience leading architecture efforts for performance-sensitive systems such as latency-critical services, multi-tenant platforms, or large-scale indexing pipelines.
- Strong communication skills and the ability to work effectively in fast-paced, cross-functional environments.
- Strategic mindset with the ability to align engineering execution with longer-term product and company goals.
- Passion for mentoring and developing other engineers.
Benefits
- Comprehensive benefits and perks are offered, with specific details varying by region.
Tech Stack
Databricks
Categories
Data Engineering
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.