Senior Software Engineer, Foundation Model API
Databricksabout 4 hours ago
Base Salary
$160k - $225k/yr
Responsibilities
- Build LLM infrastructure for large-scale inference workloads.
- Shape the direction of the FMAPI product from roadmap to execution.
- Improve reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infrastructure, and ML teams.
- Enhance how developers and data scientists interact with AI on Databricks.
Requirements
- 8+ years of experience in backend or infrastructure engineering.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Strong product and ownership mindset focused on user-facing value.
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
- Strong programming skills in Scala, Go, or Python.