Staff Backend Software Engineer- (AI Platform)
Databricks5 months ago
Base Salary
$192k - $260k/yr
Responsibilities
- Design and implement scalable core systems and APIs for Databricks Model Serving.
- Define technical roadmaps and long-term architecture with product and engineering leadership.
- Optimize performance, throughput, autoscaling, and operational efficiency for CPU and GPU serving workloads.
- Build and improve model container builds, deployment workflows, routing, caching, observability, and intelligent autoscaling.
- Collaborate with product, platform, infrastructure, and research teams to translate customer needs into reliable systems.
- Lead initiatives improving latency, availability, and cost-effectiveness across serving layers.
- Establish code quality, testing, and operational-readiness practices while mentoring engineers.
- Represent the team in cross-organizational technical discussions and influence AI platform strategy.
Requirements
- 10+ years of experience building and operating large-scale distributed systems.
- Deep expertise in model serving, inference systems, routing, scheduling, autoscaling, and observability infrastructure.
- Strong foundation in algorithms, data structures, and system design for large-scale, low-latency serving systems.
- Experience leading architecture for large-scale, performance-sensitive CPU/GPU inference systems.
- Proven ability to deliver technically complex, high-impact initiatives with measurable customer or business value.
- Strong communication and cross-functional collaboration skills.
- Strategic and product-oriented mindset aligned with long-term technical vision.
- Passion for mentoring engineers and fostering technical excellence.
Benefits
- Comprehensive benefits and perks are offered, with region-specific details available through Databricks’ benefits portal.
Tech Stack
Apache SparkMLflow
Categories
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and over 60% of the Fortune 500 — rely on Databricks to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified Data Intelligence Platform that includes Agent Bricks, Lakeflow, Lakehouse, Lakebase and Unity Catalog. --- Databricks applicants Please apply through our official Careers page at databricks.com/company/careers. All official communication from Databricks will come from email addresses ending with @databricks.com or @goodtime.io (our meeting tool).