Senior Machine Learning Engineer: Search Quality
Constructor5 months ago
Remote, WorldwideSenior
Base Salary
$80k - $120k/yr
Responsibilities
- Build LLM-based relevance evaluation systems that understand query intent, represent catalog items, and align judgments with user behavior.
- Develop real-time reranking, filtering, and signal-computation models while balancing search quality and latency.
- Create automated quality-monitoring pipelines and agent-based systems that identify degradations and generate actionable recommendations.
- Optimize and scale LLM inference across a global customer base spanning 40+ languages and 20+ domains.
- Design and run A/B tests to validate model impact and collaborate with ranking, product, and data engineering teams.
Requirements
- 4+ years of experience shipping production machine learning systems.
- Experience with search, information retrieval, or recommendation systems.
- Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments.
- Strong Python and PyTorch skills, plus fluency in SQL and data orchestration tools including Spark and Airflow.
- Experience designing and running A/B tests to validate model impact.
- Excellent English communication skills and experience collaborating cross-functionally.
Benefits
- Fully remote work arrangement with flexibility to choose where to live.
- Regular team offsite events.
- Unlimited vacation, with at least three weeks per year encouraged.
- Work-from-home stipend and an Apple laptop for new employees.
- Annual training and development budget.
- Maternity and paternity leave for qualified employees.
- Stock options in addition to the base salary.
Tech Stack
Categories
About Constructor
Constructor builds an AI-powered search and product discovery platform for ecommerce retailers, marketplaces, and distributors, delivered as enterprise SaaS. Its tools power on-site search, browse, recommendations, and shopping agents to optimize conversions and merchandising outcomes. Founded in 2019 by Eli Finkelshteyn and Dan McCormick, the San Francisco–based, privately held company counts brands such as Sephora, Under Armour, and Petco as customers and raised a Series B in 2024.