Time since we first saw it
Day 5
Early. Similar jobs usually come down between day 7 and day 50.
From 678 similar postings that came down. Coming down is not always a hire.
Fully remote. Projects may last from one week to several months.
Live, first seen by us 5 days agoCompensation & Benefits Compensation is $45 to $90 per hour, depending on project, field, and experience level. Payment is for hours worked. LocationRead the full posting
Location Fully remote. Projects may last from one week to several months.
Listed location: remoteRead the full posting
Employment type in the employer’s posting: FullTimeFrom the employer’s posting
Lead data operations for projects supporting advanced AI development.
Lead data sourcing and collection programs by writing specifications, setting acceptance criteria, and tracking yield and quality.
Design synthetic data generation pipelines and validation checks to determine which data meets project standards.
Write and maintain labelling guidelines, addressing gaps and updating guidance as edge cases arise.
Lead data operations for projects supporting advanced AI development. As part of a flexible expert network, you will be matched with projects that fit your background and work directly with project teams to help ensure the quality of datasets used to train and evaluate models.
What You'll Do Lead data sourcing and collection programs by writing specifications, setting acceptance criteria, and tracking yield and quality. Coordinate media capture and document contributions at scale, then curate and validate the resulting datasets.
Coordinate media capture and document contributions at scale, then curate and validate the resulting datasets. Design synthetic data generation pipelines and validation checks to determine which data meets project standards. Review annotations, resolve disagreements, and run calibration and audit rounds with annotator teams.
Review annotations, resolve disagreements, and run calibration and audit rounds with annotator teams. Write and maintain labelling guidelines, addressing gaps and updating guidance as edge cases arise. Coach reviewers and annotators, and report agreement rates, error rates, and other quality metrics to project teams.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
Day 5
Early. Similar jobs usually come down between day 7 and day 50.
From 678 similar postings that came down. Coming down is not always a hire.
37 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Experience owning labelling guidelines and running annotation review, calibration, or audit rounds, including measuring agreement or error rates. - Hands-on familiarity with tools such as Label Studio, Labelbox, CVAT, Scale, Remotasks, or Appen, plus spreadsheets or SQL for quality analysis. - Clear written communication, with the ability to explain data quality issues and solutions.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Lead data operations for projects supporting advanced AI development. As part of a flexible expert network, you will be matched with projects that fit your background and work directly with project teams to help ensure the quality of datasets used to train and evaluate models.
Lead data sourcing and collection programs by writing specifications, setting acceptance criteria, and tracking yield and quality.
Coordinate media capture and document contributions at scale, then curate and validate the resulting datasets.
Design synthetic data generation pipelines and validation checks to determine which data meets project standards.
Review annotations, resolve disagreements, and run calibration and audit rounds with annotator teams.
Write and maintain labelling guidelines, addressing gaps and updating guidance as edge cases arise.
Coach reviewers and annotators, and report agreement rates, error rates, and other quality metrics to project teams.
At least 5 years of experience in data operations, annotation QA, data quality, dataset management, or a related field; alternatively, 5+ years of domain expertise with hands-on human-data work.
Experience leading or reviewing others' work on data projects, such as as a QA lead, guideline owner, adjudicator, team lead, or project manager.
Experience running data sourcing or collection programs, writing specifications, setting acceptance criteria, and tracking results.
Experience owning labelling guidelines and running annotation review, calibration, or audit rounds, including measuring agreement or error rates.
Hands-on familiarity with tools such as Label Studio, Labelbox, CVAT, Scale, Remotasks, or Appen, plus spreadsheets or SQL for quality analysis.
Clear written communication, with the ability to explain data quality issues and solutions.
Experience with synthetic data validation, media capture, document contribution, large-scale dataset curation, or coaching annotators is useful.
Compensation is $45 to $90 per hour, depending on project, field, and experience level. Payment is for hours worked.
Fully remote. Projects may last from one week to several months.
New Data Operations postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Operations, by the work the posting describes.
Data operations staff do the day-to-day work of getting data processed correctly: loading and checking files, moving records between systems, fixing errors and following set procedures.
Expect Excel, some SQL, close attention to detail, and knowledge of the particular systems the company runs.
Data governance sets the rules for the data; data operations does the hands-on work of processing it and keeping it moving.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation & Benefits Compensation is $45 to $90 per hour, depending on project, field, and experience level. Payment is for hours worked. Location
remote
Location Fully remote. Projects may last from one week to several months.
No clear work-authorization passage found. Eligibility is unconfirmed.