Back to jobs

Research Engineer / Scientist, Data & Evals

London · London, England, United Kingdom

Live, first seen by us 22 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
Location type: Hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Research — team source
Department: Research
From the employer’s posting

What you’ll work on

Full posting

In this role, you'll build the data and measurement systems that power our post-training, benchmarking, and agent capability efforts.

We recently post-trained our first model built for legal work, and we’re now building the team to scale up our post-training efforts.

  • Build synthetic data pipelines that generate, filter, and curate training and evaluation samples

  • Design evaluations and verifiers that reflect real legal work and calibrate them against expert judgment

  • Build and maintain capability benchmarks like the Legal Agent Benchmark (LAB) and product evals

  • Work with legal experts to define quality metrics, rubrics, and grading mechanisms

  • Own training and evaluation data quality, including provenance, coverage, and contamination safeguards

From the employer’s posting
In this role, you'll build the data and measurement systems that power our post-training, benchmarking, and agent capability efforts.
We recently post-trained our first model built for legal work, and we’re now building the team to scale up our post-training efforts. You’ll own synthetic data pipelines, evaluation design, the tasks and grading behind training environments, and the systems that turn feedback from domain experts into training signals and rewards. These are tasks where correctness often can’t be verified automatically, so defining and measuring quality is a core research challenge. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person owns a large part of the work.
Build synthetic data pipelines that generate, filter, and curate training and evaluation samples for complex legal reasoning and agentic workflows.
Design evaluations and verifiers that reflect real legal work, calibrate them against expert judgment, and investigate where they fail.
Build and maintain capability benchmarks like our Legal Agent Benchmark (LAB), along with product-focused evals that track how models perform on real customer workflows.
Work with legal domain experts to define quality metrics, rubrics, and other grading mechanisms for training and evaluation.
Own training and evaluation data quality, including provenance, coverage, and safeguards against contamination.

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or will you in the future require employment visa sponsorship?
From the employer’s application form
Apply at Harvey

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 30, 202622 days ago
Recorded sightings
23
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 22

Similar jobs usually come down between day 7 and day 76.

At Harvey, jobs usually come down by about day 60.

From 6,394 similar postings that came down, and 18 of Harvey’s. Coming down is not always a hire.

Harvey is hiring

16 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
Where the posting names them
What You Have - Experience building data pipelines, ML evaluation systems, or experimentation tooling, with strong Python skills and ownership of production-quality code. - A rigorous approach to measurement, including statistical reasoning, experimental design, and understanding when a metric can mislead.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Has Harvey posted this job before?

Yes. We’ve followed 3 other Research Engineer / Scientist, Data & Evals jobs there since October 2026. All 3 are still up.

  1. New YorkStill up after 23 days, first seen Oct 30
  2. San FranciscoStill up after 23 days, first seen Oct 30
  3. Place not statedStill up after 22 days, first seen Oct 30
  4. This jobUp 22 days so far, first seen Oct 30

Large employers often post one title for several teams, so these can be separate openings.

Job description

View original posting ↗

Why Harvey

At Harvey, we’re transforming how legal and professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re reshaping how critical knowledge work gets done for decades to come.

This is a rare chance to help build a generational company at a true inflection point. We have strong product-market fit and world-class investor support. We’re scaling fast and defining a new category in real time. The work is ambitious, the bar is high, and the opportunity for growth — personal, professional, and financial — is unmatched.

Our team moves fast, takes ownership, and is deeply committed to the mission — operating with intensity, staying close to our customers, and pushing each other for excellence. We live by three values: Decisiveness, Simplicity, and Job's Not Finished. We act quickly on clear judgment over perfect information, we believe simplicity is what scales, and we're never satisfied with where we are. If you want to do the best work of your career alongside people who share that drive, we'd love to build with you.

At Harvey, the future of professional services is being written today — and we’re just getting started.

Role Overview

In this role, you'll build the data and measurement systems that power our post-training, benchmarking, and agent capability efforts.

We recently post-trained our first model built for legal work, and we’re now building the team to scale up our post-training efforts. You’ll own synthetic data pipelines, evaluation design, the tasks and grading behind training environments, and the systems that turn feedback from domain experts into training signals and rewards. These are tasks where correctness often can’t be verified automatically, so defining and measuring quality is a core research challenge. You’ll join a small, high-bar team of hands-on engineers and researchers, where each person owns a large part of the work.

We’re looking for research engineers who can build reliable data and evaluation systems, question what a metric actually tells us, and work closely with researchers and legal experts to turn model failures into measurable improvements.

Learn more about our work at harvey.ai/research.

What You'll Do
  • Build synthetic data pipelines that generate, filter, and curate training and evaluation samples for complex legal reasoning and agentic workflows.

  • Design evaluations and verifiers that reflect real legal work, calibrate them against expert judgment, and investigate where they fail.

  • Build and maintain capability benchmarks like our Legal Agent Benchmark (LAB), along with product-focused evals that track how models perform on real customer workflows.

  • Work with legal domain experts to define quality metrics, rubrics, and other grading mechanisms for training and evaluation.

  • Own training and evaluation data quality, including provenance, coverage, and safeguards against contamination.

  • Close the loop from product usage and customer feedback to new evaluations and training data, so models improve where customers need them most.

  • Partner with researchers to investigate model failures, distinguish real gains from misleading metrics, and use findings to guide training and release decisions.

What You Have
  • Experience building data pipelines, ML evaluation systems, or experimentation tooling, with strong Python skills and ownership of production-quality code.

  • A rigorous approach to measurement, including statistical reasoning, experimental design, and understanding when a metric can mislead.

  • The ability to translate ambiguous goals or expert judgment into structured datasets, rubrics, and measurable criteria.

  • Experience with synthetic data, LLM evaluations, automated raters, or preference data is a plus. Strong data and measurement engineering experience close to ML model development is valuable even without prior LLM work.

We are hiring for this role across multiple levels.

Depending on your location, an Applicant Privacy Notice may apply to you. You can find all of our Applicant Privacy Notices here.

#LI-DZ1

We are an AI company and we use AI to improve all of our processes, including in the recruitment process. While we do use AI to help improve efficiency in our recruitment process, we do not rely on AI to make any automated decisions and ensure that a human reviews AI output.

Harvey is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made by emailing accommodations@harvey.ai

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

London, England, United Kingdom

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.