Back to jobs

Member of Technical Staff, Data Analysis and Evaluation

London · San Francisco · New York · Paris · Toronto · Montreal · London, United Kingdom

Open 5 months, first seen by us 172 days ago
Pay
Pay not listed
Work setting
Remote — work setting source
Location type: Remote
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Modeling › Post-Training — team source
Department: Modeling › Post-Training
From the employer’s posting

What you’ll work on

Full posting

As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs).

This role combines expertise in statistics, experimental design incl.

  • Design and oversee data collection tasks, including supporting human annotators

  • Apply statistical methods to evaluate dataset quality and reliability

  • Analyse generalisability and robustness of ML systems across use cases

  • Train and fine-tune LLMs on distributed training infrastructure

  • Run experiments to evaluate model performance and find areas to improve

From the employer’s posting
As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs). Your primary focus will be on designing and conducting data collection tasks, assessing and evaluating dataset quality, and analysing the robustness and generalisability of our models. You will work closely with cross-functional teams, including researchers, engineers, and data annotators, to conduct data-driven decision-making and improve the overall effectiveness of our AI systems.
This role combines expertise in statistics, experimental design incl. human annotators, and machine learning to ensure that our models are trained on high-quality data and perform reliably across diverse scenarios. You will contribute to Cohere’s mission of advancing AI by ensuring our systems are robust, scalable, and impactful.
Design and oversee data collection tasks, including supporting human annotators and ensuring data quality
Develop and apply statistical methods to evaluate the quality and reliability of datasets
Analyse and assess the generalisability and robustness of ML systems across diverse use cases
Train and fine-tune large language models (LLMs) on distributed training infrastructures
Conduct experiments to evaluate model performance and identify areas for improvement

What you’ll bring

All qualifications

Core experience

  • Strong expertise in designing and conducting data collection tasks, including working with human annotators.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • 6 weeks of paid vacation (30 working days!)
  • Experience analysing datasets with respect to their quality, biases, and suitability for training ML models.
  • Hands-on experience training large language models (LLMs) on distributed training infrastructures.
  • Familiarity with evaluating and improving the generalisability and robustness of ML systems.
Qualification wording
Strong expertise in designing and conducting data collection tasks, including working with human annotators.
100% Parental Leave top-up for up to 6 months, for either parent.
6 weeks of paid vacation (30 working days!)
Experience analysing datasets with respect to their quality, biases, and suitability for training ML models.
Hands-on experience training large language models (LLMs) on distributed training infrastructures.
Familiarity with evaluating and improving the generalisability and robustness of ML systems.
Apply at Cohere

Posting record

Report an error

Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 2, 2026172 days ago
Recorded sightings
235
Last seen by us
Nov 21, 2026
Employer says posted
Dec 15, 2025

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 172

Up longer than most. Similar jobs usually come down between day 7 and day 60.

At Cohere, jobs usually come down by about day 152.

From 12,338 similar postings that came down, and 8 of Cohere’s. Coming down is not always a hire.

Cohere is hiring

17 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • PyTorch
  • TensorFlow
Where the posting names them
- Familiarity with evaluating and improving the generalisability and robustness of ML systems. - Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX). - Excellent communication skills to collaborate effectively with cross-functional teams and present findings.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Role Overview:

As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs). Your primary focus will be on designing and conducting data collection tasks, assessing and evaluating dataset quality, and analysing the robustness and generalisability of our models. You will work closely with cross-functional teams, including researchers, engineers, and data annotators, to conduct data-driven decision-making and improve the overall effectiveness of our AI systems.

This role combines expertise in statistics, experimental design incl. human annotators, and machine learning to ensure that our models are trained on high-quality data and perform reliably across diverse scenarios. You will contribute to Cohere’s mission of advancing AI by ensuring our systems are robust, scalable, and impactful.

Please Note: We have offices in London, Paris, Toronto, San Francisco, and New York, but we also embrace being remote-friendly! There are no restrictions on where you can be located for this role.

Key Responsibilities:

  • Design and oversee data collection tasks, including supporting human annotators and ensuring data quality.

  • Develop and apply statistical methods to evaluate the quality and reliability of datasets.

  • Analyse and assess the generalisability and robustness of ML systems across diverse use cases.

  • Collaborate with teams to improve dataset quality and model performance.

  • Train and fine-tune large language models (LLMs) on distributed training infrastructures.

  • Conduct experiments to evaluate model performance and identify areas for improvement.

Qualifications:

  • Extremely strong software engineering skills.

  • Strong expertise in designing and conducting data collection tasks, including working with human annotators.

  • Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance.

  • Experience analysing datasets with respect to their quality, biases, and suitability for training ML models.

  • Hands-on experience training large language models (LLMs) on distributed training infrastructures.

  • Familiarity with evaluating and improving the generalisability and robustness of ML systems.

  • Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX).

  • Excellent communication skills to collaborate effectively with cross-functional teams and present findings.

  • One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).

* This is neither an exhaustive nor necessary set of attributes. Even if none of these apply to you, but you believe you will contribute to Cohere, please reach out. We value diverse backgrounds and perspectives at Cohere.

Working Location:
This role can be based remotely or from one of our office locations listed on the job description - there is no minimum in-office qualification requirement. We care most about hiring exceptional people regardless of locations, though please check the location listed on the posting for guidance around the core time zone or working hours alignment expected for the role.

Full-Time Employees at Cohere enjoy these Perks:

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:

  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.


We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Demand for Data Scientist roles

New Data Scientist postings at the employers we follow are up 3% over the last 6 weeks compared with the 6 before.

Weekly new Data Scientist postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 1,389, the most 2,932, and the latest week had 1,705.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Scientist, by the work the posting describes.

Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.

Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.

Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.

US government figures for data scientists

Median yearly pay, May 2025
$120,230
Expected change, 2025 to 2035
34.6% more jobsagainst 3.5% for all jobs

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

London, United Kingdom

This role combines expertise in statistics, experimental design incl. human annotators, and machine learning to ensure that our models are trained on high-quality data and perform reliably across diverse scenarios. You will contribute to Cohere’s mission of advancing AI by ensuring our systems are robust, scalable, and impactful. Please Note: We have offices in London, Paris, Toronto, San Francisco, and New York, but we also embrace being remote-friendly! There are no restrictions on where you can be located for this role. Key Responsibilities:
More source context
- 6 weeks of paid vacation (30 working days!) - Budget for traveling to other offices if you are remote, plus an annual company offsite. How and Where We Work: - Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon. - For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.