GrepJob
Highlight AI

Senior ML Engineer

Highlight AI
Apply
4 months ago
San Francisco, CA, USASenior / Mid Level

Base Salary

$200k - $350k/yr

Responsibilities

  • Design, build, and optimize ML pipelines for context retrieval, action detection, and output generation.
  • Implement and iterate on RAG systems, ranking models, and prompt engineering to improve quality.
  • Build comprehensive evals and monitoring to measure and improve ML system performance.
  • Investigate alternative models and fine-tuning approaches for background processing workloads.
  • Collaborate with Backend and Product Engineering to ship AI-powered features.
  • Contribute to ML infrastructure decisions and best practices across the engineering organization.
  • Stay current on LLM advances, retrieval techniques, and ML tooling.

Requirements

  • 4+ years in ML/AI engineering with significant experience shipping production systems.
  • Strong software engineering fundamentals with clean, maintainable code.
  • Deep experience with retrieval, ranking, RAG, or search systems at scale.
  • Hands-on proficiency with PyTorch, vector databases, and modern ML infrastructure.
  • Experience with LLM applications including prompt engineering and eval frameworks.
  • Product thinker who connects ML products to constraints, evals, and modeling.
  • Bias toward action with a focus on fast shipping and data-driven iteration.
  • Ownership mentality with a collaborative mindset and excellent communication skills.
  • Must be based in or willing to relocate to SF.

Benefits

  • Competitive salary and generous equity package.
  • Health, dental, and vision insurance.
  • Flexible PTO and parental leave.
  • Paid team lunches during the week.
  • Relocation package.

Tech Stack

PyTorch

Categories

AI & MLData Engineering