Senior Engineer, Model Serving
Databricks
4 months ago
San Francisco, CA, USA
Senior
H1B Sponsor
Base Salary
$166k - $225k/yr
Responsibilities
- Design and implement core systems and APIs for Model Serving.
- Drive architectural decisions to optimize performance and efficiency.
- Contribute to components like model container builds and runtime systems.
- Collaborate with product and research teams to meet customer needs.
- Lead initiatives to improve latency and cost-effectiveness.
- Establish best practices for code quality and mentor other engineers.
Requirements
- 5+ years of experience in large-scale distributed systems.
- Experience in model serving or related infrastructure.
- Strong foundation in algorithms and system design for low-latency systems.
- Proven ability to deliver high-impact technical initiatives.
- Experience with CPU/GPU inference systems architecture.
- Strong communication skills for cross-team collaboration.
- Customer-focused mindset with alignment to product goals.
- Passion for mentoring and fostering technical excellence.
Benefits
- Comprehensive benefits and perks tailored to employee needs.
Tech Stack
Apache SparkDatabricksMLflow
Categories
AI & MLData Engineering