Back to jobs

Validation Engineer, AI & Data

Indianapolis, Indiana, United States

Actively hiring, first seen by us 7 days ago
Pay
Pay not listedSimilar roles state $119K–$194K
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Design the testing strategy for the Domain Context Model, Business Context Repository, and ontology mappings

  • Build ground truth question and answer test sets with expected results and tolerances, validated by data owners

  • Build and maintain automated tests that evaluate AI responses from the Context Injection toolkit

  • Identify and classify AI failures such as hallucinations, stale information, and faulty joins

  • Verify context repository data completeness, classification, and access control behavior

From the employer’s posting
Design and implement the testing strategy for the Domain Context Model, Business Context Repository, ontology mappings, and AI response evaluation.
Develop representative ground truth question and answer test sets with defined expected results and tolerances, validated by data owners.
Build and maintain automated evaluation tests for AI responses generated through the client’s Context Injection toolkit.
Identify and classify failures, including hallucinations, stale information, incorrect schemas, faulty joins, missing business context, and persona mismatches.
Verify context repository data completeness, classification consistency, access control behavior, and changes introduced through automated context updates.

What you’ll bring

All qualifications

Core experience

  • Data quality engineering and ETL and data validation
  • SQL and Python
  • PyTest or equivalent test frameworks
  • AI and LLM evaluation, including ground truth and regression testing
Qualification wording
Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks, ETL and data validation, AI and LLM evaluation, ground truth testing, regression testing, and test automation.
Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks
PyTest or equivalent frameworks
AI and LLM evaluation, ground truth testing, regression testing, and test automation.
Apply at Radcube

Posting record

Report an error

Actively hiringFirst seen by us 7 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 11, 20267 days ago
Recorded sightings
8
Last seen by us
Nov 18, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$119K–$194K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 3,947 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 7

Early. Similar jobs usually come down between day 8 and day 60.

From 12,086 similar postings that came down. Coming down is not always a hire.

Radcube is hiring

20 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
Where the posting names them
Validation Engineer, AI & Data Location: Indianapolis, IN Summary: Validate the accuracy, reliability, completeness, and consistency of business context and AI generated responses against approved business requirements and ground truth answers. Responsibilities: Design and implement the testing strategy for the Domain Context Model, Business Context Repository, ontology mappings, and AI response evaluation. Develop representative ground truth question and answer test sets with defined expected results and tolerances, validated by data owners. Build and maintain automated evaluation tests for AI responses generated through the client’s Context Injection toolkit. Evaluate AI responses with and without domain context to establish baseline accuracy and measure improvements. Validate numeric answers, SQL and query results, business logic, aggregations, join relationships, and narrative responses. Identify and classify failures, including hallucinations, stale information, incorrect schemas, faulty joins, missing business context, and persona mismatches. Develop repeatable evaluation scripts, scoring rubrics, regression tests, and accuracy reporting dashboards or scorecards. Verify context repository data completeness, classification consistency, access control behavior, and changes introduced through automated context updates. Document test evidence, defects, remediation results, AI readiness assessments, and validation outcomes. Support release readiness, weekly demonstrations, and handover of reusable evaluation frameworks and documentation. Requirements Required Technical Expertise: Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks, ETL and data validation, AI and LLM evaluation, ground truth testing, regression testing, and test automation.

Your next step

Complete your application on radcube.zohorecruit.in. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Validation Engineer, AI & Data Location: Indianapolis, IN Summary: Validate the accuracy, reliability, completeness, and consistency of business context and AI generated responses against approved business requirements and ground truth answers. Responsibilities: Design and implement the testing strategy for the Domain Context Model, Business Context Repository, ontology mappings, and AI response evaluation. Develop representative ground truth question and answer test sets with defined expected results and tolerances, validated by data owners. Build and maintain automated evaluation tests for AI responses generated through the client’s Context Injection toolkit. Evaluate AI responses with and without domain context to establish baseline accuracy and measure improvements. Validate numeric answers, SQL and query results, business logic, aggregations, join relationships, and narrative responses. Identify and classify failures, including hallucinations, stale information, incorrect schemas, faulty joins, missing business context, and persona mismatches. Develop repeatable evaluation scripts, scoring rubrics, regression tests, and accuracy reporting dashboards or scorecards. Verify context repository data completeness, classification consistency, access control behavior, and changes introduced through automated context updates. Document test evidence, defects, remediation results, AI readiness assessments, and validation outcomes. Support release readiness, weekly demonstrations, and handover of reusable evaluation frameworks and documentation. Requirements Required Technical Expertise: Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks, ETL and data validation, AI and LLM evaluation, ground truth testing, regression testing, and test automation.

Demand for Data Scientist roles

New Data Scientist postings at the employers we follow are up 4% over the last 6 weeks compared with the 6 before.

Weekly new Data Scientist postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 1,402, the most 2,948, and the latest week had 1,744.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Scientist, by the work the posting describes.

Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.

Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.

Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.

US government figures for data scientists

Median yearly pay, May 2025
$120,230
Expected change, 2025 to 2035
34.6% more jobsagainst 3.5% for all jobs

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Indianapolis, Indiana, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.