GrepJob
Databricks

Senior Staff Applied AI Engineer - Context Retrieval

Databricks
Apply
about 2 months ago
Mountain View, CA, USA or San Francisco, CA, USASenior / Staff+
H1B Sponsor

Base Salary

$229k - $343k/yr

Responsibilities

  • Build the full retrieval stack from scratch, including query and content understanding.
  • Retrieve across heterogeneous data, indexing and ranking both structured and unstructured assets.
  • Connect to the SaaS surface area where enterprise knowledge resides.
  • Optimize retrieval for both LLMs and human users.
  • Develop query understanding tailored for agentic workflows.
  • Create pipelines for content understanding at scale.
  • Design search subagents that reason about retrieval needs.
  • Establish evaluation metrics and processes for retrieval and subagents.
  • Set technical direction and mentor team members.

Requirements

  • 10+ years of software engineering experience with a focus on production retrieval systems.
  • Deep expertise in Information Retrieval techniques and systems.
  • Hands-on experience with modern LLM-era retrieval methods.
  • Experience designing agentic systems on top of retrieval.
  • Strong understanding of relevance evaluation metrics and methodologies.
  • Experience working with both structured and unstructured data.
  • Proven track record of building systems from the ground up.
  • Demonstrated ability to lead technical initiatives and mentor engineers.

Tech Stack

Apache SparkDatabricksElasticsearchMLflowSQL

Categories

AI & MLData EngineeringData Science