Staff Software Engineer, Foundational Model Serving
Databricks12 months ago
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement scalable, reliable core systems and APIs for Databricks Foundation Model Serving.
- Define the technical roadmap and long-term architecture for serving workloads with product and engineering leadership.
- Make architectural decisions to optimize performance, throughput, autoscaling, and operational efficiency for GPU serving workloads.
- Contribute to serving infrastructure components, including vLLM, SGLang, token-based rate limiters, and optimizers.
- Collaborate with product, platform, and research teams to translate customer needs into reliable and performant systems.
- Establish code quality, testing, and operational-readiness practices and mentor engineers through design reviews and technical guidance.
- Represent the team in cross-organizational technical discussions and influence Databricks’ broader AI platform strategy.
Requirements
- 10+ years of experience building and operating large-scale distributed systems.
- Experience leading high-scale, operationally sensitive backend systems.
- Track record of improving engineering excellence across teams.
- Strong foundation in algorithms, data structures, and system design for large-scale, low-latency serving systems.
- Proven ability to deliver technically complex, high-impact initiatives with measurable customer or business value.
- Strong communication and cross-functional collaboration skills.
- Strategic, product-oriented mindset aligned with long-term technical vision.
- Passion for mentoring engineers and fostering technical excellence.
Benefits
- Comprehensive benefits and perks, with region-specific details available through Databricks’ benefits portal.
Tech Stack
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.