Machine Learning Engineer - Evaluation
HackerRankabout 3 hours ago
Santa Clara, CA, USA
Mid Level / Senior
H1B Sponsor
Base Salary
$120k - $235k/yr
Responsibilities
- Build LLM-powered evaluation pipelines for assessing AI usage skills.
- Own the evaluation methodology from rubric creation to bias auditing.
- Design and run experiments to determine effective evaluation standards.
- Develop RAG pipelines and fine-tuning workflows for reliable evaluation models.
- Define benchmarking infrastructure to monitor evaluation quality.
- Translate model behavior into understandable outcomes for stakeholders.
Requirements
- Experience shipping LLM-powered systems in production.
- Strong focus on measurement methodology alongside model development.
- Research mindset with comfort in undefined problem spaces.
- Ability to think in systems, integrating data pipelines and models.
- Skill in communicating ML concepts to non-technical audiences.
Categories
AI & MLData Science