Constructor

Senior Machine Learning Engineer: Search Quality

Constructor
Apply
3 months ago
Remote, WorldwideSenior

Base Salary

$80k - $120k/yr

Responsibilities

  • Build LLM-based relevance evaluation systems that understand query intent, represent catalog items, and align judgments with user behavior.
  • Develop real-time reranking, filtering, and signal-computation models while balancing search quality and latency.
  • Create automated quality-monitoring pipelines and agent-based systems that identify degradations and generate actionable recommendations.
  • Optimize and scale LLM inference across a global customer base spanning 40+ languages and 20+ domains.
  • Design and run A/B tests to validate model impact and collaborate with ranking, product, and data engineering teams.

Requirements

  • 4+ years of experience shipping production machine learning systems.
  • Experience with search, information retrieval, or recommendation systems.
  • Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments.
  • Strong Python and PyTorch skills, plus fluency in SQL and data orchestration tools including Spark and Airflow.
  • Experience designing and running A/B tests to validate model impact.
  • Excellent English communication skills and experience collaborating cross-functionally.

Benefits

  • Fully remote work arrangement with flexibility to choose where to live.
  • Regular team offsite events.
  • Unlimited vacation, with at least three weeks per year encouraged.
  • Work-from-home stipend and an Apple laptop for new employees.
  • Annual training and development budget.
  • Maternity and paternity leave for qualified employees.
  • Stock options in addition to the base salary.

Tech Stack

Categories

Constructor

About Constructor

1,001-5,000 employees
Contact me