Staff Software Engineer - Search Platform
Databricks2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead development and deployment of ML-based search and discovery relevance models and systems integrated with Databricks products and services.
- Design and implement ML and NLP pipelines for data preprocessing, query understanding and rewriting, ranking, retrieval, and model evaluation.
- Collaborate with product managers and cross-functional teams on technology-led search and discovery initiatives and product roadmaps.
- Build frameworks for evaluating search-ranking improvements through both offline and online methods.
Requirements
- Bachelor’s degree or higher in Computer Science or a related field; a master’s degree or PhD is preferred.
- 10+ years of experience developing search relevance systems at scale in production or high-impact research environments.
- Experience applying LLMs to search relevance.
- Experience in one or more of query understanding, NLP, text mining, recommendations, personalization, discovery, or conversational AI.
- Strong understanding of computer science fundamentals.
- Contributions to well-used open-source projects.
Benefits
- Databricks provides comprehensive employee benefits and perks, with specific offerings varying by region.
Tech Stack
DatabricksSQL
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.