Pay
Higher than most similar jobs
$130K–$225K against $105K–$170K, the middle half of what similar US postings state.
From 109 postings in the last year. Stated ranges, not salaries paid.
United States
Actively hiring, first seen by us 4 hours agoCompensation & Benefits Base salary: $130,000 to $225,000 annually. Visa sponsorship is available. LocationRead the full posting
Work setup in the employer’s posting: On-siteFrom the employer’s posting
Employment type in the employer’s posting: FullTimeFrom the employer’s posting
Lead the data quality team at an early-stage AI company building infrastructure for reinforcement learning and model evaluation.
Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits.
Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
Lead the data quality team at an early-stage AI company building infrastructure for reinforcement learning and model evaluation. You will shape how training data is assessed and improved, helping research teams create more reliable and useful AI agents.
What You'll Do Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows. Set data quality strategy, establish standards, and design experiments to assess agent outputs.
Set data quality strategy, establish standards, and design experiments to assess agent outputs. Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits. Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits. Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation. Turn research insights into production tools, dashboards, validation pipelines, and feedback loops.
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Higher than most similar jobs
$130K–$225K against $105K–$170K, the middle half of what similar US postings state.
From 109 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 6 and day 54.
From 1,533 similar postings that came down. Coming down is not always a hire.
16 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Experience leading technical projects or teams through ambiguous problem definition, implementation, and iteration. - Advanced proficiency in Python, Docker, and Linux. - Background in AI evaluations, post-training, benchmarks, synthetic data pipelines, or model evaluation infrastructure.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
New Data Governance postings at the employers we follow are up 196% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Governance, by the work the posting describes.
Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.
Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.
A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.
Lead the data quality team at an early-stage AI company building infrastructure for reinforcement learning and model evaluation. You will shape how training data is assessed and improved, helping research teams create more reliable and useful AI agents.
Lead development of systems that evaluate tasks across reinforcement learning environments, synthetic data, benchmarks, and domain-specific workflows.
Set data quality strategy, establish standards, and design experiments to assess agent outputs.
Develop scalable methods for validating synthetic data, including failure analysis, task mutation checks, and trajectory audits.
Work with research engineers, domain experts, and data vendors to diagnose quality issues and improve data generation.
Turn research insights into production tools, dashboards, validation pipelines, and feedback loops.
Mentor research engineers and promote technical rigor, clear communication, and strong execution.
At least 5 years of research or engineering experience focused on AI/ML data evaluation or data quality systems.
Experience leading technical projects or teams through ambiguous problem definition, implementation, and iteration.
Advanced proficiency in Python, Docker, and Linux.
Background in AI evaluations, post-training, benchmarks, synthetic data pipelines, or model evaluation infrastructure.
Strong judgment about what makes agent training data realistic, learnable, diverse, reliable, and useful.
Experience designing metrics, experiments, and quality processes, and translating research findings into production systems.
Ability to work with subject-matter experts and convert domain judgment into scalable review or generation workflows.
Strong written communication, attention to detail, and experience in an early-stage startup environment.
Base salary: $130,000 to $225,000 annually. Visa sponsorship is available.
On-site in the United States. The primary city was not specified.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation & Benefits Base salary: $130,000 to $225,000 annually. Visa sponsorship is available. Location
United States
Location On-site in the United States. The primary city was not specified.
Compensation & Benefits Base salary: $130,000 to $225,000 annually. Visa sponsorship is available. Location