Define and own the evaluation strategy for the agentic AI system
Build and maintain automated evaluation pipelines for quality, safety and alignment
Run systematic experiments on reasoning, factuality, robustness and user experience
Work with model developers and research scientists to drive iterative improvement
From the employer’s posting
Define and own the evaluation strategy for our AI agentic system
Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
Run systematic experiments to assess reasoning, factuality, robustness, and user experience
Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
Education & alternatives
You'll be a great fit if you:
- Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field
- Have 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
Free comprehensive health insurance (basic package) for you and your children
25 days of paid vacation per year, plus up to 14 days of RTT
Free mental health and coaching services through our partner Moka.care
ParentCare Program: Enjoy full salary coverage (100%) during your first month of birth leave, and 75% during the second, covered by Doctolib
For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
Relocation support in case of international mobility
Our interview process
Recruiter Interview
Technical Deep Dive
Data System Design
Behavioral Interview
At least one reference check
Job details
Permanent position
Full-time
We welcome everyone
At Doctolib, we are committed to improving access to healthcare for everyone. This translates into our recruitment process. We evaluate candidates based solely on qualifications and motivation, without any form of discrimination.
The more diverse ideas are heard, the more our product will truly improve healthcare for all. You are welcome to apply to Doctolib, regardless of your gender, religion, age, sexual orientation, ethnicity, or disability.
To ensure equal opportunities, we invite you to exclude personal information (e.g., pictures, age) from your applications. If you require any accommodation, please let us know for support during the hiring process.
Join us in building the healthcare we all dream of!
Open 4 monthsWe first saw this posting 124 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
Status in our records
Live
First seen by us
Jul 3, 2026124 days ago
Recorded sightings
123
Last seen by us
Nov 2, 2026
Jul 3, 2026today
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Time since we first saw it
Day 124
670
Up longer than most. Similar jobs usually come down between day 6 and day 70.
Well past Doctolib’s usual: its jobs come down by about day 15.
From 4,442 similar postings that came down, and 14 of Doctolib’s. Coming down is not always a hire.
Doctolib is hiring
10 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Java
Kotlin
Python
TypeScript
React
Where the posting names them
- Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to country and healthcare specialty requirements.
- Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
- We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here.
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Applying through Greenhouse
No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.
New ML Engineer postings at the employers we follow are up 12% over the last 5 weeks compared with the 5 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 5 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
US government figures for computer and information research scientists
Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
We are looking for a Senior Machine Learning Engineer to join the Orchestration team in AI Health Assistant.
Your mission will be to ensure our AI Health Companion behaves safely, reliably, and helpfully — for millions of patients and practitioners. You will work in a cross-functional team building robust evaluation pipelines for agentic AI systems, contributing directly to improving the quality and safety of AI-powered healthcare.
Working in the tech team at Doctolib means building innovative products and features to improve the daily lives of care teams and patients.
What you'll do
Your responsibilities include but are not limited to:
Define and own the evaluation strategy for our AI agentic system — metrics, protocols, datasets, and tooling
Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
Run systematic experiments to assess reasoning, factuality, robustness, and user experience
Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices
Life at Doctolib Tech
Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to country and healthcare specialty requirements.
Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here.
Want to learn more about our tech culture and environment? Visit the Doctolib Tech site.
Who you are
Before you read on: if you don't have the exact profile described below, but you feel this job description matches your skill set, we still encourage you to apply.
You'll be a great fit if you:
Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field
Have 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
Have proven experience evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants)
Have a strong track record in experiment design, metric definition, and evaluation automation
Are able to bridge research and production, influencing both modeling and product decisions
Have excellent communication skills, a collaborative mindset, and are fluent in English
It would be fantastic if you:
Have experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI
What we offer
Free comprehensive health insurance (basic package) for you and your children
25 days of paid vacation per year, plus up to 14 days of RTT
Free mental health and coaching services through our partner Moka.care
Work from abroad for up to 10 days per year thanks to our flexibility days policy
Lunch vouchers (Swile card) worth €8.50 per working day, with €4.50 covered by Doctolib
A subsidy from the work council to refund part of the membership to a sport club or a creative class
50% reimbursement of your public transport subscription
ParentCare Program: Enjoy full salary coverage (100%) during your first month of birth leave, and 75% during the second, covered by Doctolib
Enrollment in Doctolib's long-term employee value sharing plan called DoctoGrowth
For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
Relocation support in case of international mobility
Access to the best AI tools for coding, development and dedicated training
Our interview process
Recruiter Interview
Technical Deep Dive
Data System Design
Behavioral Interview
At least one reference check
We want your experience to be clear, respectful, and transparent. Learn more about our hiring process on our candidate experience page.
Job details
Permanent position
Full-time
Hybrid in our Levallois-Perret office (up to 2 remote days per week)
Start date: as soon as possible
We welcome everyone
At Doctolib, we are committed to improving access to healthcare for everyone. This translates into our recruitment process. We evaluate candidates based solely on qualifications and motivation, without any form of discrimination.
The more diverse ideas are heard, the more our product will truly improve healthcare for all. You are welcome to apply to Doctolib, regardless of your gender, religion, age, sexual orientation, ethnicity, or disability.
To ensure equal opportunities, we invite you to exclude personal information (e.g., pictures, age) from your applications. If you require any accommodation, please let us know for support during the hiring process.
Join us in building the healthcare we all dream of!
Your data privacy
All information provided is processed by Doctolib for application management. For data processing details, click here: France. Please contact hr.dataprivacy(at)doctolib.com for inquiries or to exercise your rights.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Pay
No pay amount identified in the saved description.
Location & working pattern
Paris, Paris, France
- Enrollment in Doctolib's long-term employee value sharing plan called DoctoGrowth
- For caregivers and workers with disabilities, a package including an adaptation of the remote policy, extra days off for medical reasons, and psychological support
- Relocation support in case of international mobility
More source context
- Full-time
- Hybrid in our Levallois-Perret office (up to 2 remote days per week)
- Start date: as soon as possible
Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.