Staff Software Engineer- Foundation Model Inference
Databricks3 months ago
Base Salary
$190k - $265k/yr
Responsibilities
- Build LLM infrastructure for large-scale inference workloads using partner and self-hosted models.
- Improve the reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infrastructure, and ML teams on end-to-end AI experiences.
- Shape how developers and data scientists build and interact with AI on Databricks.
Requirements
- 8+ years of backend or infrastructure engineering experience.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
- Exposure to SageMaker, Vertex AI, or Azure ML is a bonus.
- Contributions to open-source projects such as MLflow, PyTorch, Ray, vLLM, or SGLang are a bonus.
- Experience building developer platforms or internal tools supporting AI workflows is a bonus.
Benefits
- Comprehensive employee benefits and perks, with details varying by region.
Tech Stack
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.