Back to jobs

Machine Learning Engineer, Model Evaluation

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Design and run LLM evaluation pipelines for accuracy, robustness, safety, and bias

  • Run stress tests, adversarial testing, and edge-case evaluations

  • Define KPIs like hallucination rate, toxicity, and factual accuracy

  • Set up real-time monitoring for drift, anomalies, and regressions

  • Feed evaluation insights into fine-tuning, RLHF/RLAIF, and model selection

From the employer’s posting
Design and implement LLM evaluation pipelines covering accuracy, robustness, safety, and bias.
Conduct stress tests, adversarial testing, and edge-case evaluations.
Define KPIs such as factual accuracy, hallucination rate, toxicity, and compliance alignment.
Establish real-time monitoring for drift, anomalies, and performance regressions.
Feed insights from evaluation into fine-tuning, RLHF/RLAIF pipelines, and model selection.
Apply at XenonStack

Posting record

Report an error

Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 3, 2026172 days ago
Recorded sightings
159
Last seen by us
Nov 22, 2026
Employer says posted
Apr 23, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 172

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

XenonStack is hiring

12 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Hugging Face
Where the posting names them
Proficiency in Python and libraries like LangChain, LangGraph, LlamaIndex, Hugging Face.

Your next step

Complete your application on xenonstack.zohorecruit.in. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

ABOUT XENONSTACK XenonStack is a Data and AI Foundry for Agentic Systems, enabling enterprises to design, deploy, operate, and scale intelligent agents across digital and physical environments. We build enterprise-grade platforms across the agentic stack: Akira AI — Reasoning and agent orchestration. Turn models into collaborative, policy-governed agents that learn and act together. ElixirData — Agentic analytics intelligence. Explainable, decision-centric analytics for measurable business outcomes. NexaStack — Agentic infrastructure automation. Secure, compliant AI deployment across cloud, edge, and on-prem. MetaSecure — Trust, compliance and defense. Continuous assurance with AI-BOMs, risk scoring, and agentic security. Our mission is to accelerate the world’s transition to AI + Human Intelligence by making agentic systems reliable, responsible, and enterprise-ready. THE OPPORTUNITY We are seeking an Machine Learning Engineer, Model Evaluation to ensure that large language models (LLMs) and agentic AI systems meet enterprise-grade standards of accuracy, safety, and trustworthiness. This role focuses on evaluating, benchmarking, and stress-testing LLMs in real-world workflows, building frameworks for reliability, robustness, and continuous improvement. If you thrive at the intersection of AI research, applied testing, and responsible deployment, this is the role for you. KEY RESPONSIBILITIES Evaluation Frameworks Design and implement LLM evaluation pipelines covering accuracy, robustness, safety, and bias. Develop automated systems for benchmarking models on enterprise-relevant tasks. Reliability Engineering Conduct stress tests, adversarial testing, and edge-case evaluations. Build tools to measure latency, consistency, and error recovery in multi-turn interactions. Metrics & Monitoring Define KPIs such as factual accuracy, hallucination rate, toxicity, and compliance alignment. Establish real-time monitoring for drift, anomalies, and performance regressions. Collaboration & Alignment Partner with ML engineers, product managers, and domain experts to align evaluation with business objectives. Work with Responsible AI teams to implement ethical, explainable, and compliant evaluation practices. Continuous Improvement Feed insights from evaluation into fine-tuning, RLHF/RLAIF pipelines, and model selection. Maintain a central repository of test cases, benchmarks, and evaluation results. Research & Innovation Stay current with state-of-the-art LLM evaluation techniques, from academic benchmarks to applied enterprise metrics. Explore automated evaluation using agentic test harnesses and synthetic data generation. SKILLS & QUALIFICATIONS Must-Have 3–6 years in AI/ML, NLP, or applied model evaluation. Strong understanding of LLM architectures, prompt engineering, and failure modes. Hands-on with evaluation frameworks (Eval harnesses, Ragas, OpenAI Evals, DeepEval). Proficiency in Python and libraries like LangChain, LangGraph, LlamaIndex, Hugging Face. Experience with vector databases, RAG pipelines, and knowledge graph integration. Familiarity with bias/fairness testing and Responsible AI frameworks. Good-to-Have Experience with reinforcement learning (RLHF, RLAIF) and reward modeling. Exposure to agentic evaluation frameworks (multi-agent stress testing, synthetic user simulators). Knowledge of compliance and safety requirements for BFSI, GRC, or SOC use cases. Contributions to open-source evaluation libraries or research papers. WHY SHOULD YOU JOIN US? Agentic AI Product Company Ensure reliability in cutting-edge AI platforms that are redefining enterprise adoption. A Fast-Growing Category Leader Be part of one of the fastest-growing AI Foundries, powering Fortune 500 enterprises with trustworthy AI. Career Mobility & Growth Grow into roles such as AI Systems Architect, Responsible AI Engineer, or Reliability Engineering Lead. Global Exposure Work on enterprise-scale evaluation challenges across BFSI, Healthcare, Telecom, and GRC. Create Real Impact Your evaluations will directly shape production-grade AI agents used in mission-critical systems. Culture of Excellence Our values — Agency, Taste, Ownership, Mastery, Impatience, and Customer Obsession — empower you to innovate fearlessly. Responsible AI First Join a company that prioritizes trustworthy, explainable, and compliant AI. XENONSTACK CULTURE – JOIN US & MAKE AN IMPACT! At XenonStack, we believe in shaping the future of intelligent systems. We foster a culture of cultivation built on bold, human-centric leadership principles, where deep work, simplicity, and adoption define everything we do. Our Cultural Values Agency – Be self-directed and proactive. Taste – Sweat the details and build with precision. Ownership – Take responsibility for outcomes. Mastery – Commit to continuous learning and growth. Impatience – Move fast and embrace progress. Customer Obsession – Always put the customer first. Our Product Philosophy Obsessed with Adoption – Making AI accessible, reliable, and enterprise-ready. Obsessed with Simplicity – Turning complex evaluation challenges into seamless, automated frameworks. Be part of our mission to accelerate the world’s transition to AI + Human Intelligence — by making AI agents not just powerful, but trustworthy and reliable.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Mohali, Punjab, India

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.