Back to jobs

Staff/Principal AI/ML Engineer

Boston, MA · Boston, Massachusetts, United States

Actively hiring, first seen by us 7 days ago
Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
Not stated
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering — team source
Department: Engineering
From the employer’s posting

What you’ll work on

Full posting
  • Design the shared LLM platform: model gateway, prompt versioning, caching, and PHI-safe guardrails

  • Build tool-using agents that summarize histories, reconcile medications and surface care gaps

  • Build RAG and hybrid search over FHIR resources and clinical notes with grounded citations

  • Stand up offline and online evals, golden datasets, and production monitoring for safety

  • Fine-tune and distill smaller models for clinical extraction, coding and normalization

From the employer’s posting
Design the shared infrastructure every AI feature at Zus runs on: model gateway and routing across frontier and open-weight models, prompt and version management, caching, cost and latency controls, and PHI-safe guardrails.
Ship tool-using agents that reason over a patient's longitudinal record by summarizing histories, reconciling medications, surfacing care gaps and answering clinician questions with cited evidence.
Build RAG and hybrid search over FHIR resources and unstructured notes: chunking and embedding strategies for clinical text, vector and graph retrieval, reranking, and grounding so every answer traces back to its source document.
Stand up offline and online evals: golden datasets with clinical reviewers, LLM-as-judge pipelines, regression suites in CI, and production monitoring for hallucination, drift and safety.
Fine-tune and distill (LoRA/PEFT, SFT, preference optimization) for clinical extraction, coding and normalization tasks where smaller, cheaper, specialized models win.

Before you apply

Employer’s visa record
1 H-1B petition approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or in the future require sponsorship?
From the employer’s application form
Education & alternatives
- Experience as the first or founding ML engineer at a growth-stage company. - MS or PhD in a quantitative field. We will offer you…

About Zus Health

Through our nationwide data network, platform, and intelligent workflows, we help providers, value-based care organizations, payers, life sciences, and digital health companies drive business results, strengthen provider trust, and improve operational efficiency.

In the employer’s words · Read in context · Company website ↗

Apply at Zus Health

Posting record

Report an error

Actively hiringFirst seen by us 7 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 10, 20267 days ago
Recorded sightings
8
Last seen by us
Nov 17, 2026
Employer says posted
Oct 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,505 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 7

Similar jobs usually come down between day 7 and day 76.

From 5,830 similar postings that came down. Coming down is not always a hire.

Zus Health is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Hugging Face
  • PyTorch
Where the posting names them
- A rigorous approach to evaluation: you've designed eval sets and metrics, and you don't ship on vibes. - Strong Python and software engineering fundamentals; fluency in PyTorch and the Hugging Face ecosystem. - Production experience on a major cloud (AWS preferred) with containers, and infrastructure as code.
- Strong Python and software engineering fundamentals; fluency in PyTorch and the Hugging Face ecosystem. - Production experience on a major cloud (AWS preferred) with containers, and infrastructure as code. - Sound judgment about safety, privacy and reliability when models touch sensitive data.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Who we are

Zus Health is an AI-native healthcare data platform that brings fragmented patient information together to make it complete, current, and actionable. Through our nationwide data network, platform, and intelligent workflows, we help providers, value-based care organizations, payers, life sciences, and digital health companies drive business results, strengthen provider trust, and improve operational efficiency. Founded in 2021 by Jonathan Bush, co-founder and former CEO of athenahealth, Zus is building the foundation for a more connected, precise, and effective healthcare system.

What we’re looking for…

Zus is hiring a Staff/Principal AI/ML Engineer to define how LLMs and AI agents power our products and the AI platform underneath them. You'll be one of the most seasoned AI/ML voices in the building, with real ownership of architecture, tooling and roadmap.

Zus aggregates clinical data from across the healthcare ecosystem. That data is messy, multi-modal and enormously valuable. Modern foundation models finally make it possible to turn it into structured, trustworthy insight at the point of care and across populations. Your job is to make that happen, safely and at scale.

This is a hands-on role. You'll write production code, ship prototypes to real users, set technical direction, and mentor the engineers who build alongside you. This work will require interactions with solution engineers, product managers, sales, and marketing.

As part of our team, you will...

  • Architect our LLM platform. Design the shared infrastructure every AI feature at Zus runs on: model gateway and routing across frontier and open-weight models, prompt and version management, caching, cost and latency controls, and PHI-safe guardrails.

  • Build agentic systems. Ship tool-using agents that reason over a patient's longitudinal record by summarizing histories, reconciling medications, surfacing care gaps and answering clinician questions with cited evidence. Use patterns like MCP servers, function calling and multi-step planning.

  • Own retrieval over clinical data. Build RAG and hybrid search over FHIR resources and unstructured notes: chunking and embedding strategies for clinical text, vector and graph retrieval, reranking, and grounding so every answer traces back to its source document.

  • Make evaluation a first-class system. Stand up offline and online evals: golden datasets with clinical reviewers, LLM-as-judge pipelines, regression suites in CI, and production monitoring for hallucination, drift and safety.

  • Adapt models when prompting isn't enough. Fine-tune and distill (LoRA/PEFT, SFT, preference optimization) for clinical extraction, coding and normalization tasks where smaller, cheaper, specialized models win.

  • Run AI/ML in production. Build CI/CD for models and prompts, inference serving, observability and human-in-the-loop feedback loops that turn user corrections into better models.

  • Prototype with users. Work directly with providers, product managers and engineers to find high-leverage problems, ship prototypes fast, and iterate on real usage.

  • Set the bar. Lead design reviews, write the docs and standards others build on, mentor engineers, and keep Zus current as the AI landscape moves.

What you bring…

  • 7+ years building and shipping AI/ML systems, including 2+ years putting LLM-powered products into production for real users.

  • Hands-on depth in modern LLM engineering: RAG, agents and tool use, structured outputs, prompt and context engineering, and the trade-offs between frontier APIs and open-weight models.

  • A track record of building ML infrastructure others depend on — serving, pipelines, model and prompt versioning, CI/CD, monitoring.

  • A rigorous approach to evaluation: you've designed eval sets and metrics, and you don't ship on vibes.

  • Strong Python and software engineering fundamentals; fluency in PyTorch and the Hugging Face ecosystem.

  • Production experience on a major cloud (AWS preferred) with containers, and infrastructure as code.

  • Sound judgment about safety, privacy and reliability when models touch sensitive data.

  • Clear writing and communication; you can explain model behavior and risk to clinicians, product leaders and executives.

  • BS in Computer Science, Statistics or a related field, or equivalent experience.

  • Are in the Boston metro and excited to collaborate in person on a hybrid schedule, or are remote (EST/CST) but willing to travel for in person collaboration occasionally.

Bonus points…

  • Healthcare or clinical NLP experience, especially with FHIR, C-CDA, clinical terminologies or HIPAA-regulated data.

  • Fine-tuning, distillation or preference optimization of LLMs at meaningful scale.

  • Built MCP servers or multi-agent systems used in production.

  • Inference optimization: quantization, speculative decoding, batching, GPU cost management.

  • Designed and executed pre-training of transformer models.

  • Open-source contributions, publications or talks in ML, NLP or LLM systems.

  • Experience as the first or founding ML engineer at a growth-stage company.

  • MS or PhD in a quantitative field.

We will offer you…
  • Competitive compensation that reflects the value you bring to the team, and a combination of cash and equity

  • For full-time permanent roles, robust benefits that include health insurance, wellness benefits, 401k with a match, and unlimited PTO.

  • Opportunity to work alongside a passionate team that is determined to help change the world (and have fun doing it)

Please Note: Research shows that candidates from underrepresented backgrounds often don’t apply unless they meet 100% of the job criteria. While we have worked to consolidate the minimum qualifications for each role, we aren’t looking for someone who checks each box on a page; we’re looking for active learners and people who care about disrupting the current healthcare system with their unique experiences.

We do not conduct interviews by text nor will we send you a job offer unless you've interviewed with multiple people, including the Director of People & Talent, over video interviews. Job scams do exist so please be careful with your personal information.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Boston, Massachusetts, United States

- Build agentic systems. Ship tool-using agents that reason over a patient's longitudinal record by summarizing histories, reconciling medications, surfacing care gaps and answering clinician questions with cited evidence. Use patterns like MCP servers, function calling and multi-step planning. - Own retrieval over clinical data. Build RAG and hybrid search over FHIR resources and unstructured notes: chunking and embedding strategies for clinical text, vector and graph retrieval, reranking, and grounding so every answer traces back to its source document. - Make evaluation a first-class system. Stand up offline and online evals: golden datasets with clinical reviewers, LLM-as-judge pipelines, regression suites in CI, and production monitoring for hallucination, drift and safety.
More source context
- BS in Computer Science, Statistics or a related field, or equivalent experience. - Are in the Boston metro and excited to collaborate in person on a hybrid schedule, or are remote (EST/CST) but willing to travel for in person collaboration occasionally. Bonus points…
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.