Staff Software Engineer, Foundation Model API
Databricks2 months ago
Base Salary
$190k - $265k/yr
Responsibilities
- Build LLM infrastructure for large-scale inference through partner and self-hosted models.
- Shape the FMAPI product roadmap and execution through engagement with enterprise users and model providers.
- Improve reliability, latency, and efficiency of distributed AI workloads.
- Collaborate with platform, infrastructure, and ML teams on seamless end-to-end experiences.
- Improve how developers and data scientists build and interact with AI on Databricks.
Requirements
- 8+ years of experience in backend or infrastructure engineering.
- Experience with distributed systems, scalable APIs, or cloud-native infrastructure.
- Experience with real-time serving, ML infrastructure, or GPU orchestration.
- Familiarity with service-oriented architecture, deployment pipelines, and system observability.
- Strong programming skills in Scala, Go, or Python.
- Strong product ownership mindset and focus on shipping user-facing value.
- Bonus: exposure to SageMaker, Vertex AI, or Azure ML.
- Bonus: experience building products that support AI workflows.
Benefits
- Comprehensive benefits and perks are offered, with details varying by region.
Tech Stack
Categories
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).