Databricks

Senior Staff Software Engineer- Search Quality

Databricks

Apply
about 7 hours ago
Bengaluru, India
Senior / Staff+
H1B Sponsor

Responsibilities

  • Optimize the retrieval layer for AI agents to ensure accurate data synthesis.
  • Enhance traditional search experiences for human users through intuitive interfaces.
  • Develop hybrid retrieval solutions that balance keyword-based and semantic vector search.
  • Fine-tune ranking models for both human readability and AI context.
  • Build evaluation frameworks to measure search relevance and quality.

Requirements

  • Proficient in Lucene/Elasticsearch and ranking algorithms.
  • Strong understanding of relevance metrics such as nDCG and Precision@K.
  • Experience in building evaluation frameworks for search quality.
  • Familiarity with traditional Information Retrieval principles and Retrieval-Augmented Generation.

Benefits

  • Comprehensive benefits and perks tailored to employee needs.

Tech Stack

Apache SparkElasticsearchMLflowSQL

Categories

AI & MLData ScienceTesting