Staff Software Engineer- Search Quality
Databricks
about 7 hours ago
Bengaluru, India
Staff+
H1B Sponsor
Responsibilities
- Own the quality of search results for AI agents and human users.
- Optimize the retrieval layer for AI to ensure accurate business actions.
- Enhance traditional search experiences for employees.
- Balance traditional keyword-based search with semantic vector search.
- Fine-tune ranking models for both human readability and AI context.
- Build guardrails and relevance scoring to maintain high-stakes accuracy.
- Connect data across structured and unstructured sources.
Requirements
- Proficient in Lucene/Elasticsearch, embeddings, and ranking algorithms.
- Strong understanding of relevance metrics like nDCG, MRR, and Precision@K.
- Experience in building evaluation frameworks for search quality.
- Ability to apply traditional Information Retrieval principles to modern contexts.
Tech Stack
Apache SparkElasticsearchMLflowSQL
Categories
AI & MLData ScienceTesting