1 month ago
Paris, FranceSenior / Staff+
Responsibilities
- Define and own the evaluation strategy for AI systems, including metrics and protocols.
- Implement and maintain automated evaluation pipelines to monitor model quality.
- Run systematic experiments to assess reasoning, factuality, and user experience.
- Collaborate with model developers and research scientists for iterative improvements.
- Contribute to research and knowledge sharing on LLM evaluation methodologies.
Requirements
- MSc or PhD in Computer Science, Machine Learning, Data Science, or related field.
- 7+ years of hands-on experience with large language models.
- Proven experience in evaluating agentic or reasoning systems.
- Strong track record in experiment design and evaluation automation.
- Ability to bridge research and production, influencing modeling decisions.
- Excellent communication skills and a collaborative mindset.
Benefits
- Free health insurance for you and your children.
- Additional month of leave for parental care.
- Free mental health and coaching services.
- Flexible remote work policy for caregivers and workers with disabilities.
- Work from EU countries and the UK for up to 10 days per year.
- Subsidy for sport club membership or creative classes.
- Up to 14 days of RTT.
- Lunch voucher with Swile card.
Tech Stack
Categories
Data Science
About Doctolib
We’re a B Corp company committed to build together the healthcare we all dream of. More than 2,900 Doctolibers in France, Germany, Italy, and the Netherlands are helping to improve the daily lives of care teams with a new generation of technologies and services. At the same time, Doctolib is helping over 80 million patients to effectively manage their health and provide quick and easy access to optimal healthcare.