Staff Engineer, Model Serving
Databricks
4 months ago
San Francisco, CA, USA
Staff+
H1B Sponsor
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement core systems and APIs for Databricks Model Serving.
- Partner with leadership to define the technical roadmap and architecture.
- Drive architectural decisions to optimize performance and operational efficiency.
- Contribute to key components of the serving infrastructure.
- Collaborate with cross-functional teams to meet customer needs.
- Lead initiatives to improve latency, availability, and cost-effectiveness.
- Establish best practices for code quality and mentor other engineers.
- Represent the team in cross-organizational technical discussions.
Requirements
- 10+ years of experience building and operating large-scale distributed systems.
- Deep expertise in model serving and inference systems.
- Strong foundation in algorithms, data structures, and system design.
- Proven ability to deliver high-impact technical initiatives.
- Experience leading architecture for performance-sensitive CPU/GPU systems.
- Strong communication skills for collaboration in fast-moving environments.
- Strategic mindset to align technical execution with long-term vision.
- Passion for mentoring and fostering technical excellence.
Tech Stack
Apache SparkDatabricksMLflow
Categories
AI & MLData Engineering