Senior Staff Software Engineer, AI Runtime
Databricks5 hours ago
Base Salary
$229k - $343k/yr
Responsibilities
- Drive AI Runtime architecture and Databricks’ long-term technical direction in AI training infrastructure.
- Define reliability and observability strategies for a growing, complex fleet.
- Shape the developer experience for people and agents running large-scale training jobs.
- Solve multi-node training problems involving orchestration, GPU scheduling, data loading, and checkpointing.
- Improve training speed and cost efficiency across model architectures and GPU accelerators.
- Collaborate with research, product, customers, and engineering teams to set priorities and resolve technical trade-offs.
- Champion engineering excellence, mentor engineers, and help hire and grow the team.
Requirements
- 15+ years of experience in large-scale distributed systems, with significant depth in GPU training, high-performance computing, or ML systems.
- Hands-on experience training large models with FSDP, DeepSpeed, or Megatron and strong knowledge of parallelism strategies.
- Expertise in GPU performance, accelerator architecture, high-speed interconnects, and kernels.
- Strong understanding of training resilience patterns, including checkpointing, failure detection, and automatic recovery.
- Experience building and operating multi-tenant cloud platforms as products.
- Demonstrated ability to set technical direction across teams and deliver business impact.
- Ability to align teams on difficult technical trade-offs and mentor senior engineers.
- BS in Computer Science or a related field required; MS or PhD preferred.
Benefits
- Comprehensive benefits and perks are offered, with details varying by region.
- The compensation package may include an annual performance bonus and equity.
Tech Stack
Databricks
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.