Develop internal tooling to speed up evaluation, annotation, and iteration cycles.
From the employer’s posting
Responsibilities
Build, curate, and maintain agentic workflows along with datasets for training and evaluation.
Run systematic LLM evaluations, track regressions, and ensure models meet quality bars.
Run systematic LLM evaluations, track regressions, and ensure models meet quality bars.
Define and implement LLM performance metrics(e.g., correctness, latency, hallucination control, safety).
Work closely with Product and Customer-facing teams, experiment with prompting techniques, fine-tuning datasets, retrieval strategies, and model configurations and ensure agent behaviour aligns with user expectations.
Work closely with Product and Customer-facing teams, experiment with prompting techniques, fine-tuning datasets, retrieval strategies, and model configurations and ensure agent behaviour aligns with user expectations.
Develop internal tooling to speed up evaluation, annotation, and iteration cycles.
Build automated pipelines for regression checks and model monitoring.
Open 5 monthsWe first saw this posting 173 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
Status in our records
Live
First seen by us
Jun 2, 2026173 days ago
Recorded sightings
35
Last seen by us
Nov 22, 2026
Employer says posted
Nov 20, 2025
Jun 2, 2026today
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Time since we first saw it
Day 173
776
Up longer than most. Similar jobs usually come down between day 7 and day 76.
From 6,389 similar postings that came down. Coming down is not always a hire.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
JavaScript
Where the posting names them
- Tune latency, turn-taking, and conversational naturalness for voice AI systems.
- Write clean, reliable code in Python or JS for model pipelines, tools, and integrations.
- Think in systems: from data ingestion to model outputs to user-facing behaviour.
We’re looking for an AI Engineer to help us design, evaluate, and scale our next generation of LLM-powered agents. This role is deeply technical, but also product and customer-oriented: you’ll build datasets, run evaluations, improve model performance, and ensure our agents deliver real value in real workflows.
As an AI Engineer, you’ll work across Engineering, Product, and Customer teams to continuously improve our agent quality, reliability, and speed. You won’t just build agents — you’ll build the systems, metrics, and feedback loops that make those agents better over time.
Responsibilities
Build, curate, and maintain agentic workflows along with datasets for training and evaluation.
Run systematic LLM evaluations, track regressions, and ensure models meet quality bars.
Work closely with Product and Customer-facing teams, experiment with prompting techniques, fine-tuning datasets, retrieval strategies, and model configurations and ensure agent behaviour aligns with user expectations.
Develop internal tooling to speed up evaluation, annotation, and iteration cycles.
Build automated pipelines for regression checks and model monitoring.
Create mechanisms that turn real user interactions into actionable model improvements.
Ensure agents behave consistently across large-scale production scenarios.
Debug complex system behaviours spanning prompts, tools, APIs, and model responses.
To understand real-world use cases and failure modes. Translate customer insights into model needs, data requirements, and product improvements.
Tune latency, turn-taking, and conversational naturalness for voice AI systems.
Write clean, reliable code in Python or JS for model pipelines, tools, and integrations.
Think in systems: from data ingestion to model outputs to user-facing behaviour.
Success Looks Like
Strong evaluation coverage with clear, actionable metrics.
Faster iteration cycles due to improved internal tools and workflows.
Measurable improvement in agent accuracy, consistency, and safety.
Reliable agent performance in production — fewer escalations, fewer regressions.
Clear alignment between customer needs and agent capabilities.
Smooth collaboration across engineering, product, and customer teams.
What We’re Looking For
2–5 years experience in software engineering, with strong fundamentals in building reliable, scalable systems.1–2 years of experience working on AI-backed products(LLM engineering, evaluations, prompting, or agent development).
Hands-on experience with LLMs, prompt engineering, evaluation frameworks, or dataset creation.
Strong understanding of how LLMs work: prompting, fine-tuning, evaluation, guardrails, and system design.
Solid software engineering skills and comfort with APIs and cloud environments.
Experience building internal tools or automation pipelines.
Ability to think from the customer backward: empathetic, detail-oriented, and outcome-driven.
Excellent communicator who collaborates well across cross-functional teams.
Fast learner who loves turning cutting-edge research into practical, dependable systems.
Bonus: experience with voice AI, speech technologies, or real-time agent systems.
Why This Role Matters
In healthcare, accuracy and trust are everything. Patients, providers, and payers rely on our AI agents to handle critical interactions. Deployment Engineers make this possible by turning AI from a raw model into something practical, reliable, and human-friendly.
Why 100ms.ai
You'll be part of a small team at a fast-growing engineering-first startup.
You'll work with engineers across the globe with experience in video at places like Facebook and Hotstar.
You can grow as an individual contributor or as a team leader - freedom to set your own goals.
Salary
2,000,000 – 5,000,000 INR per year
Demand for ML Engineer roles
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
US government figures for computer and information research scientists
Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.