Pay
$100K–$169K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 163 postings in the last year. Stated ranges, not salaries paid.
San Francisco, CA · London · New York, NY · San Francisco, California, United States
Open 5 months, first seen by us 172 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: Research › Data AcquisitionFrom the employer’s posting
Data is playing an increasingly crucial role at the frontier of AI innovation.
As a member of the Data Team, your mission is to ensure that the data used to train our models meets a high bar for quality, reliability, and downstream impact.
Own upstream data quality for LLM pre-training across languages and modalities
Design, validate, and scale automated QA methods across large data campaigns
Build reusable QA pipelines that deliver high-quality data to pre-training teams
Monitor and report on data quality over time and refine quality standards
Give actionable quality feedback to external data vendors
Data is playing an increasingly crucial role at the frontier of AI innovation. Many of the most meaningful advances in recent years have come not from new architectures, but from better data.
As a member of the Data Team, your mission is to ensure that the data used to train our models meets a high bar for quality, reliability, and downstream impact. You will directly shape how our models perform on critical capabilities.
Own upstream data quality for LLM pre-training; as a specialist or generalist across languages and modalities
design, validate, and scale automated QA methods to reliably measure data quality across large campaigns
Build reusable QA pipelines that reliably deliver high-quality data to pre-training teams for model training
Monitor and report on data quality over time, driving continuous iteration on quality standards, processes, and acceptance criteria
provide actionable feedback to external data vendors
Solid understanding of how data quality impacts pre-training, with the ability to translate quality concerns into concrete signals, decisions, and feedback
Proficiency in Python and building ML / LLM workflows. Must be comfortable debugging and writing scalable code
Experience designing and validating automated quality checks, including rule-based systems, statistical methods, or model-assisted approaches such as LLM-as-a-Judge
Experience working with large datasets and automated evaluation or quality-checking systems
Familiarity with how LLMs work and can describe how models are trained and evaluated
Excellent communication skills with the ability to clearly articulate complex technical concepts across teams
From the employer’s posting.
We build open models that let anyone control their intelligence and help shape the future of AI.
In the employer’s words · Read in context
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$100K–$169K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 163 postings in the last year. Stated ranges, not salaries paid.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 52.
From 2,085 similar postings that came down. Coming down is not always a hire.
10 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Skills and Qualifications - Proficiency in Python and building ML / LLM workflows. Must be comfortable debugging and writing scalable code - Experience working with large datasets and automated evaluation or quality-checking systems
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all.
Data is playing an increasingly crucial role at the frontier of AI innovation. Many of the most meaningful advances in recent years have come not from new architectures, but from better data.
As a member of the Data Team, your mission is to ensure that the data used to train our models meets a high bar for quality, reliability, and downstream impact. You will directly shape how our models perform on critical capabilities.
Working with world-class researchers on our pre-training teams, you’ll help turn fuzzy notions of “good data” into concrete, measurable standards that scale across large data campaigns. We’re looking for engineers who combine strong engineering fundamentals with a deep curiosity about data quality and its impact on model performance.
Working closely with our pre-training teams you will:
Own upstream data quality for LLM pre-training; as a specialist or generalist across languages and modalities
Partner closely with research and pre-training teams to translate requirements into measurable quality signals, and provide actionable feedback to external data vendors
In addition to human-in-the-loop processes, you will design, validate, and scale automated QA methods to reliably measure data quality across large campaigns
Build reusable QA pipelines that reliably deliver high-quality data to pre-training teams for model training
Monitor and report on data quality over time, driving continuous iteration on quality standards, processes, and acceptance criteria
Strong engineering fundamentals with experience building data pipelines, QA systems, or evaluation workflows for pre-training data
Detail-oriented with an analytical mindset, able to identify failure modes, inconsistencies, and subtle issues that affect data quality
Solid understanding of how data quality impacts pre-training, with the ability to translate quality concerns into concrete signals, decisions, and feedback
Experience designing and validating automated quality checks, including rule-based systems, statistical methods, or model-assisted approaches such as LLM-as-a-Judge
Comfortable working autonomously, owning problems end-to-end, and collaborating effectively with researchers, engineers, and operations partners
Proficiency in Python and building ML / LLM workflows. Must be comfortable debugging and writing scalable code
Experience working with large datasets and automated evaluation or quality-checking systems
Familiarity with how LLMs work and can describe how models are trained and evaluated
Excellent communication skills with the ability to clearly articulate complex technical concepts across teams
We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models.
We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.
Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
Meals: Lunch and dinner are provided in the office daily.
Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
Team building: We have regular off-sites, happy hours, and team celebrations.
Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization.
Equal Employment Opportunity Statement
Reflection AI is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), sexual orientation, gender identity or expression, national origin, ancestry, age, marital status, disability, genetic information, veteran or military status, or any other characteristic protected by applicable law. We encourage applicants from all backgrounds to apply.
We provide reasonable accommodations throughout the hiring process for applicants with disabilities, pregnancy-related limitations, or religious needs. If you need an accommodation, contact us at accommodations@reflection.ai.
We will consider for employment qualified applicants with arrest and conviction records in accordance with applicable law, including the San Francisco Fair Chance Ordinance and the California Fair Chance Act.
Candidate and Employee Privacy Notice: We collect and process personal data about applicants for the purposes described in our Candidate and Employee Privacy Notice
New Data Governance postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Governance, by the work the posting describes.
Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.
Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.
A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
Working pattern and location restrictions need checking in the full posting.
- Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. - Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. - Team building: We have regular off-sites, happy hours, and team celebrations.