Staff Software Engineer, AI Search
Databricks5 months ago
Base Salary
$166k - $225k/yr
Responsibilities
- Drive the architecture and evolution of the Search product, delivering scalable, low-latency, high-quality retrieval across massive multimodal datasets.
- Solve challenges in indexing, storage, query execution, ranking, vector search, keyword search, and hybrid retrieval.
- Partner with infrastructure, product, and research teams to shape APIs and developer experiences for production-grade AI-powered and search-driven applications.
- Lead engineering efforts from design through production rollout with high standards for performance, correctness, and reliability.
- Make high-impact contributions to systems powering search, discovery, and recommendation experiences.
- Mentor engineers through design reviews, technical discussions, and collaborative development.
- Influence long-term technical planning for search, AI infrastructure, and data systems.
Requirements
- 10+ years of experience building and operating large-scale distributed systems.
- Deep expertise in vector, keyword, and hybrid search, including indexing, ranking, retrieval infrastructure, and relevance optimization.
- Familiarity with storage systems, recommendation engines, and database internals.
- Strong foundation in algorithms, data structures, and system design for large-scale retrieval and data systems.
- Proven ability to deliver technically complex, high-impact initiatives that create customer or business value.
- Experience leading architecture for performance-sensitive, large-scale systems.
- Strong communication and cross-team collaboration skills.
- Strategic and product-oriented mindset aligned with long-term technical vision.
- Passion for mentoring engineers and fostering technical excellence.
Tech Stack
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.