Staff Software Engineer - Machine Learning (Search)
Databricks2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead development and deployment of ML-based search and discovery relevance models and systems integrated with Databricks products and services.
- Design and implement automated ML and NLP pipelines for data preprocessing, query understanding and rewriting, ranking, retrieval, and model evaluation.
- Collaborate with product managers and cross-functional teams on technology-first search and discovery initiatives.
- Build frameworks for evaluating search ranking improvements through offline and online methods.
Requirements
- Bachelor’s degree or higher in Computer Science or a related field; M.S. or PhD preferred.
- 10+ years of experience developing search relevance systems at scale in production or in high-impact research environments.
- Experience applying LLMs to search relevance.
- Experience with one or more of query understanding, NLP, text mining, recommendations, personalization, discovery, or conversational AI.
- Strong understanding of computer science fundamentals.
- Contributions to well-used open-source projects.
Benefits
- Comprehensive benefits and perks are offered, with details varying by region.
- Databricks provides a global, collaborative environment focused on state-of-the-art AI and ML products.
Tech Stack
Databricks
Categories
About Databricks
Databricks builds a cloud-based data and AI platform centered on the lakehouse architecture, combining data engineering, analytics, and machine learning with Apache Spark, Delta Lake, and MLflow. It sells subscriptions and cloud services to enterprises that need to unify data pipelines and develop large-scale AI and analytics. Founded in 2013 by the creators of Apache Spark and headquartered in San Francisco, the company is privately held and serves organizations across many industries.