Time since we first saw it
Day 43
Similar jobs usually come down between day 5 and day 43.
At Elsevier, jobs usually come down by about day 24.
From 16,018 similar postings that came down, and 33 of Elsevier’s. Coming down is not always a hire.
Employment type in the employer’s posting: Full timeFrom the employer’s posting
The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data.
A key focus of this role is adapting and validating automated evaluation approaches.
Adapt and validate LLM-as-jury evaluation approaches for specific products and metrics
Build and curate scientific test sets and benchmarks from life sciences and regulatory data
Run manual and automated evaluations of AI outputs and investigate failure modes
Contribute to evaluation rubrics, acceptance criteria, and scenarios for AI solutions
Document evaluation findings, limitations, and recommendations for cross-functional teams
The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data. Working with scientific domain experts, product, data science, and engineering teams, you will contribute to evaluation strategies and rubrics, evaluation scenarios, and acceptance criteria that reflect customer needs and product goals.
A key focus of this role is adapting and validating automated evaluation approaches. Using an “LLM as jury” framework, you will tailor evaluation criteria and methods to specific products, use cases, and metrics. You will assess the reliability of automated judgments, identify gaps or inconsistencies, and refine the approach in collaboration with relevant experts.
Adapting LLM-as-jury evaluation approaches to specific products, use cases, and metrics, and validating and refining their performance in collaboration with scientific domain experts.
Building and curating scientific test sets and benchmarks that reflect real-world use of life sciences and regulatory data.
Conducting manual and automated evaluations of AI outputs, investigating discrepancies and failure modes, and providing evidence-based feedback on evaluation quality.
Applying scientific expertise to contribute to customer-focused success criteria, evaluation rubrics, and acceptance criteria for AI solutions.
Documenting evaluation findings, limitations, and recommendations clearly for cross-functional teams to support product improvements and release decisions.
Experience evaluating AI or algorithmic outputs using scientific data.
Relevant Python skills and the confidence to use them to develop lightweight solutions, automate workflows, or support analytical tasks.
Experience applying scientific expertise in structured data or content environments, such as databases, taxonomies, knowledge graphs, or similar systems.
Familiarity with how AI products access and use data, including a general understanding of data flows, APIs, and version-controlled workflows such as GitHub.
Our mission is to enable better, more trustworthy AI-driven products by combining scientific expertise with rigorous evaluation and AI-ready data.
In the employer’s words · Read in context
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 43
Similar jobs usually come down between day 5 and day 43.
At Elsevier, jobs usually come down by about day 24.
From 16,018 similar postings that came down, and 33 of Elsevier’s. Coming down is not always a hire.
43 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Experience evaluating AI or algorithmic outputs using scientific data. - Relevant Python skills and the confidence to use them to develop lightweight solutions, automate workflows, or support analytical tasks. - Experience applying scientific expertise in structured data or content environments, such as databases, taxonomies, knowledge graphs, or similar systems.
Complete your application on relx.wd3.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Senior Data Analyst - AI Evaluation (Life Sciences).
Automate and conduct LLM-as-jury evaluations to improve AI-powered life sciences solutions through scientific expertise and rigorous analysis.
About our Team:
We are a growing team working on the evaluation of AI systems in development and on cross-domain harmonization. Our mission is to enable better, more trustworthy AI-driven products by combining scientific expertise with rigorous evaluation and AI-ready data. We generate actionable evidence that accelerates product improvement, and we unlock greater value from curated scientific knowledge by making it interoperable, interpretable, and reliably usable by AI across domains.
About the Role:
The Senior Data Analyst - AI Evaluation will support the evaluation of AI-powered solutions that use life sciences, chemistry, and regulatory data. Working with scientific domain experts, product, data science, and engineering teams, you will contribute to evaluation strategies and rubrics, evaluation scenarios, and acceptance criteria that reflect customer needs and product goals.
A key focus of this role is adapting and validating automated evaluation approaches. Using an “LLM as jury” framework, you will tailor evaluation criteria and methods to specific products, use cases, and metrics. You will assess the reliability of automated judgments, identify gaps or inconsistencies, and refine the approach in collaboration with relevant experts.
Through structured analysis, domain-informed judgment, and iterative validation you will contribute to more robust evidence of quality, faster feedback cycles for product development, and stronger alignment with real-world scientific and customer requirements.
Responsibilities:
Requirements:
Work in a way that works for you: -
We promote a healthy work/life balance across the organization. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, family leave and tuition reimbursement, we will help you meet your immediate responsibilities and long-term goals.
Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Working for you: -
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
About Us: -
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s .







We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.
Please read our Candidate Privacy Policy.
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
New Analyst postings at the employers we follow are up 26% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Analyst, by the work the posting describes.
Analysts answer business questions with data. They pull numbers with SQL, build reports and dashboards, and explain what changed and why to the people making decisions.
Most postings ask for SQL, spreadsheets, a dashboard tool such as Tableau or Power BI, and clear writing.
Unlike a data scientist, an analyst mostly explains what happened rather than building models that predict what will.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Gurgaon
Working pattern and location restrictions need checking in the full posting.
Please read our Candidate Privacy Policy. We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: