Staff Software Engineer- Foundation Model Inference
Databricksabout 5 hours ago
Base Salary
$190k - $265k/yr
Responsibilities
- Build LLM infrastructure for large-scale inference workloads.
- Improve reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infrastructure, and ML teams.
- Shape developer and data scientist interactions with AI on Databricks.
Requirements
- 8+ years of experience in backend or infrastructure engineering.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.