GrepJob
Exa

Research, Evals

Exa
Apply
9 months ago
San Francisco, CA, USAMid Level / Senior
H1B Sponsor

Base Salary

$150k - $300k/yr

Responsibilities

  • Design and implement evaluation frameworks for search engines.
  • Build scalable eval pipelines to track regressions and quality signals.
  • Create golden datasets and synthetic benchmarks for testing.
  • Collaborate with ML researchers and engineers to improve search models.
  • Write a manifesto defining what perfect search means.

Requirements

  • Hands-on ML experience in training or evaluating models, preferably related to embeddings or LLMs.
  • Strong engineering fundamentals in Python and Rust.
  • Experience with distributed pipelines and GPU/cluster jobs.
  • Ability to dive into data and design creative measurement strategies.

Benefits

  • Premium healthcare benefits including medical, dental, and vision.
  • Fertility benefits offered to all employees.
  • Monthly wellness stipend provided.

Tech Stack

Categories

AI & MLBackendData Science