Back to jobs

Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization

Pay
Pay not listed
Work setting
On-site — work setting source
Work setup in the employer’s posting: onsite
From the employer’s posting
Employment
Full-time — employment source
Employment type Full-time
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Containerize and deploy speech models on Triton Inference Server with TensorRT/FP16

  • Build CI/CD pipelines for model promotion from staging to production

  • Configure Kubernetes GPU autoscaling based on active calls or streaming sessions

  • Optimize GPU/CPU utilization, cost, and memory for concurrent speech workloads

From the employer’s posting
Containerize and deploy speech models using Triton Inference Server with TensorRT/FP16 optimizations.
Develop and manage CI/CD pipelines for model promotion (staging → production).
Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions.
Optimize GPU/CPU utilization, cost optimization, and memory footprint for concurrent ASR/TTS/Speech LLM workloads.

What you’ll bring

All qualifications

Core experience

  • 4–6 years of experience in backend or ML-ops; at least 1–2 years with GPU inference pipelines.
  • Proven experience deploying models to production environments with measurable latency gains.

Preferred experience

  • Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling.
  • Familiarity with speech inference (streaming ASR, TTS pipelines).
  • Proficient in Python, Bash, and cloud services (AWS/GCP/Azure).
  • Understanding of observability stacks (Prometheus, Grafana, ELK).
Qualification wording
4–6 years of experience in backend or ML-ops; at least 1–2 years with GPU inference pipelines.
Proven experience deploying models to production environments with measurable latency gains.
Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling.
Familiarity with speech inference (streaming ASR, TTS pipelines).
Proficient in Python, Bash, and cloud services (AWS/GCP/Azure).
Understanding of observability stacks (Prometheus, Grafana, ELK).
Apply at OutcomesAI

Posting record

Report an error

Open 7 monthsWe first saw this posting 220 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Apr 15, 2026220 days ago
Recorded sightings
117
Last seen by us
Nov 21, 2026
Employer says posted
Nov 7, 2025

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 220

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

OutcomesAI is hiring

1 open job

  • No new data jobs since April
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Bash
  • Python
  • AWS
  • Azure
  • Docker
  • GCP
  • Grafana
  • Kubernetes
  • MLflow
Where the posting names them
- Familiarity with speech inference (streaming ASR, TTS pipelines). - Proficient in Python, Bash, and cloud services (AWS/GCP/Azure). - Understanding of observability stacks (Prometheus, Grafana, ELK).
Desired Skills - Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling. - Familiarity with speech inference (streaming ASR, TTS pipelines).
- Proficient in Python, Bash, and cloud services (AWS/GCP/Azure). - Understanding of observability stacks (Prometheus, Grafana, ELK). - Knowledge of DevSecOps, access policies, and PHI-safe environments.
- Develop and manage CI/CD pipelines for model promotion (staging → production). - Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions. - Build health and observability dashboards: latency, token delay, WER drift, SNR/packet loss monitors.
- Optimize GPU/CPU utilization, cost optimization, and memory footprint for concurrent ASR/TTS/Speech LLM workloads. - Maintain data and model versioning pipelines with MLflow, DVC, or internal registries. Desired Skills

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

OutcomesAI is a healthcare technology company building an AI-enabled nursing platform designed to augment clinical teams, automate routine workflows, and safely scale nursing capacity.
Our solution combines AI voice agents and licensed nurses to handle patient communication, symptom triage, remote monitoring, and post-acute care — reducing administrative burden and enabling clinicians to focus on direct patient care. 

Our core product suite includes: 
● Glia Voice Agents – multimodal conversational agents capable of answering patient calls, triaging symptoms using evidence-based protocols (e.g., Schmitt-Thompson), scheduling visits, and delivering education and follow-ups. 
● Glia Productivity Agents – AI copilots for nurses that automate charting, scribing, and clinical decision support by integrating directly into EHR systems such as Epic and Athena. 
● AI-Enabled Nursing Services – a hybrid care delivery model where AI and licensed nurses work together to deliver virtual triage, remote patient monitoring, and specialty patient support programs (e.g., oncology, dementia, dialysis). 

Our AI infrastructure leverages multimodal foundation models — incorporating speech recognition (ASR), natural language understanding, and text-to-speech (TTS) — fine-tuned for healthcare environments to ensure safety, empathy, and clinical accuracy. All models operate within a HIPAA-compliant and SOC 2–certified framework. OutcomesAI partners with leading health systems and virtual care organizations to deploy and validate these capabilities at scale. Our goal is to create the world’s first AI + nurse hybrid workforce, improving access, safety, and efficiency across the continuum of care.  

Own the infrastructure and pipelines for integrating trained ASR/TTS/Speech-LLM models into production. Focus on scalable serving, GPU optimization, monitoring, and continuous improvement of inference latency and reliability.

What You’ll Do

  • Containerize and deploy speech models using Triton Inference Server with TensorRT/FP16 optimizations.
  • Develop and manage CI/CD pipelines for model promotion (staging → production).
  • Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions.
  • Build health and observability dashboards: latency, token delay, WER drift, SNR/packet loss monitors.
  • Integrate LM bias APIs, failover logic, and model switchers for fallback to larger/cloud models.
  • Implement on-device or edge inference paths for low-latency scenarios.
  • Collaborate with AI team to expose APIs for context biasing, rescoring, and diagnostics.
  • Optimize GPU/CPU utilization, cost optimization, and memory footprint for concurrent ASR/TTS/Speech LLM workloads.
  • Maintain data and model versioning pipelines with MLflow, DVC, or internal registries.

Desired Skills

  • Experience with Triton, TensorRT, Docker, Kubernetes, and GPU scheduling.
  • Familiarity with speech inference (streaming ASR, TTS pipelines).
  • Proficient in Python, Bash, and cloud services (AWS/GCP/Azure).
  • Understanding of observability stacks (Prometheus, Grafana, ELK).
  • Knowledge of DevSecOps, access policies, and PHI-safe environments.
  • Interest in inference optimization, mixed precision, and quantization.

Qualifications

  • B.Tech / M.Tech in Computer Science or related field.
  • 4–6 years of experience in backend or ML-ops; at least 1–2 years with GPU inference pipelines.
  • Proven experience deploying models to production environments with measurable latency gains.

Employment type

Full-time

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Bengaluru

OutcomesAI is a healthcare technology company building an AI-enabled nursing platform designed to augment clinical teams, automate routine workflows, and safely scale nursing capacity. Our solution combines AI voice agents and licensed nurses to handle patient communication, symptom triage, remote monitoring, and post-acute care — reducing administrative burden and enabling clinicians to focus on direct patient care. Our core product suite includes:

More relevant text appears in the full description.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.