Thomson Reuters

Senior Research Engineer, Model Evaluations

Thomson Reuters
Apply
3 days ago
Zug, Switzerland or London, United KingdomSenior

Responsibilities

  • Build and operate the evaluation suite for Thomson model evaluations.
  • Design and develop evaluation platforms that scale with increasing evaluation volume.
  • Implement and tune optimization techniques to reduce cost and latency while maintaining quality.
  • Contribute to production readiness and the team’s ISO 27001 compliance path.
  • Work with the evaluation team to evaluate new model releases and publish results on the leaderboard.

Requirements

  • Hands-on research engineering experience building, scaling, and optimizing evaluation suites, with examples of impact.
  • Experience collaborating with researchers and cross-functional stakeholders to translate research ideas into scalable systems.
  • Experience ensuring the reliability and scalability of research systems.
  • Familiarity with current LLM developments and designing systems that can accommodate new innovations.
  • Preferred familiarity with Inspect, Harbor, and lm-evaluation-harness.
  • Preferred familiarity with AI-assisted coding and coding agents at scale.

Benefits

  • Flexible hybrid work model for office-based roles.
  • Flexible work arrangements, including work from anywhere for up to eight weeks per year.
  • Career development, continuous learning, and skills-growth programs.
  • Comprehensive benefits including flexible vacation, two company-wide Mental Health Days, Headspace access, retirement savings, tuition reimbursement, incentive programs, and wellbeing resources.
  • Two paid volunteer days annually and opportunities for pro-bono consulting and ESG initiatives.

Categories

Thomson Reuters

About Thomson Reuters

10,000+ employees

Thomson Reuters builds research platforms, workflow software, and data services for legal, tax and accounting, compliance, and government professionals, and operates the Reuters global news service. Flagship products include Westlaw for legal research and ONESOURCE and Checkpoint for tax and accounting, sold primarily via subscriptions and enterprise licenses. A public company headquartered in Toronto, it was formed in 2008 by combining Thomson Corporation and Reuters Group and is listed on the TSX and Nasdaq as TRI.

Contact me