Senior Software Engineer — Backend (Files Team)
Databricks3 hours ago
Base Salary
$166k - $225k/yr
Responsibilities
- Design, build, and operate the filesystem platform powering data, AI, and agentic workloads.
- Profile and optimize filesystem performance from the API layer through the Linux kernel.
- Partner with platform teams to design and evolve compute and storage architectures.
- Set technical direction for organizing content across Databricks using filesystem primitives.
Requirements
- Bachelor’s degree or higher in Computer Science or a related field.
- At least 5 years of production-level experience with Java, Scala, C++, Go, Rust, or a similar language.
- At least 3 years of experience developing large-scale distributed systems.
- Experience with Kubernetes, Docker, or MicroVM technologies such as Firecracker.
- Strong understanding of cloud provider internals, including AWS, Azure, or GCP.
- Experience building tools from the ground up for large-scale environments.
- Experience with filesystems and FUSE.
- Experience building object or blob storage such as S3, Azure Blob Storage, or GCS.
- Experience with systems performance engineering across microservices and Linux.
- Background in high-scale content, storage, or file-sync products.
Tech Stack
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.