Staff Software Engineer (Search Ranking)
Databricks2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Develop and deploy ML-based search and discovery relevance models and systems integrated with Databricks products and services.
- Design and implement ML and NLP pipelines for data preprocessing, query understanding and rewriting, ranking, retrieval, and model evaluation.
- Drive technology initiatives with product managers and cross-functional teams for the search and discovery experience.
- Build frameworks to evaluate search ranking improvements through offline and online evaluations.
- Lead enhancements to search ranking, query understanding, asset coverage, and search quality at scale.
Requirements
- Bachelor’s degree or higher in Computer Science or a related field; a master’s degree or PhD is preferred.
- 10+ years of experience developing search relevance systems at scale in production or in high-impact research environments.
- Experience applying LLMs to search relevance.
- Experience with one or more of query understanding, NLP, text mining, recommendations, personalization, discovery, or conversational AI.
- Strong understanding of computer science fundamentals.
- Contributions to well-used open-source projects.
Benefits
- Comprehensive employee benefits and perks are offered, with details varying by region.
Tech Stack
DatabricksSQL
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.