Senior Machine Learning Engineer: Search Quality
Constructor3 months ago
Remote, WorldwideSenior
Base Salary
$80k - $120k/yr
Responsibilities
- Build LLM-based relevance evaluation systems that understand query intent, represent catalog items, and align judgments with user behavior.
- Develop real-time reranking, filtering, and signal-computation models while balancing search quality and latency.
- Create automated quality-monitoring pipelines and agent-based systems that identify degradations and generate actionable recommendations.
- Optimize and scale LLM inference across a global customer base spanning 40+ languages and 20+ domains.
- Design and run A/B tests to validate model impact and collaborate with ranking, product, and data engineering teams.
Requirements
- 4+ years of experience shipping production machine learning systems.
- Experience with search, information retrieval, or recommendation systems.
- Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments.
- Strong Python and PyTorch skills, plus fluency in SQL and data orchestration tools including Spark and Airflow.
- Experience designing and running A/B tests to validate model impact.
- Excellent English communication skills and experience collaborating cross-functionally.
Benefits
- Fully remote work arrangement with flexibility to choose where to live.
- Regular team offsite events.
- Unlimited vacation, with at least three weeks per year encouraged.
- Work-from-home stipend and an Apple laptop for new employees.
- Annual training and development budget.
- Maternity and paternity leave for qualified employees.
- Stock options in addition to the base salary.