Staff Backend Software Engineer- (AI Platform)
Databricks7 months ago
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement scalable, reliable core systems and APIs for Databricks Model Serving.
- Define technical roadmaps and long-term architecture for serving workloads with product and engineering leadership.
- Optimize performance, throughput, autoscaling, latency, availability, and cost efficiency across CPU and GPU inference systems.
- Develop and improve model container builds, deployment workflows, routing, caching, observability, and runtime systems.
- Collaborate with product, platform, infrastructure, and research teams to translate customer needs into performant systems.
- Lead high-impact technical initiatives and represent the team in cross-organizational architecture discussions.
- Establish practices for code quality, testing, and operational readiness.
- Mentor engineers through design reviews and technical guidance.
Requirements
- 10+ years of experience building and operating large-scale distributed systems.
- Deep expertise in model serving, inference systems, routing, scheduling, autoscaling, and observability infrastructure.
- Strong knowledge of algorithms, data structures, and system design for large-scale, low-latency serving systems.
- Experience leading architecture for performance-sensitive CPU and GPU inference systems.
- Proven ability to deliver technically complex, high-impact initiatives with measurable customer or business value.
- Strong communication and cross-functional collaboration skills.
- Strategic and product-oriented mindset aligned with long-term technical vision.
- Passion for mentoring engineers and fostering technical excellence.
Benefits
- Comprehensive benefits and perks are offered, with region-specific details available from Databricks.
- The role includes a stated local pay range of $192,000—$260,000 USD, with potential annual performance bonus and equity eligibility.
- The total compensation package may include additional benefits listed by Databricks.
Tech Stack
Databricks
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.