Back to jobs

Senior Software Platform Engineer, MLOps

San Mateo, California, United States

Actively hiring, first seen by us 11 days ago
Pay
USD 170,000–220,000/yearAnnual period assumed — pay source
No visa sponsorship is available for this position The salary range for this position is $170,000-$220,000 USD. The salary range posted reflects our target baseline for this role. Final compensation is determined by a thorough evaluation of factors including the candidate’s specific experience, localized market data, and internal team equity.
Read the full posting
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • Design and operate APIs that let customers run models and agents on their scientific data

  • Own the model and prompt lifecycle across Databricks MLflow and AWS Bedrock

  • Build the inference path for real-time and batch AI workloads

  • Integrate LLMs into production systems using RAG and agent tooling

  • Build evaluation tooling and regression gates that make AI releases shippable

From the employer’s posting
Design, build, and operate the services and APIs that let customers run models and agents against their own scientific data
Own the model and prompt lifecycle in your area across Databricks MLflow and AWS Bedrock
Build the inference path for real-time and batch AI workloads
Integrate LLMs into production systems using retrieval-augmented generation (RAG), and build agent capabilities
Build the evaluation and quality tooling that makes AI shippable

Before you apply

Work authorization
No visa sponsorship

What you’ll bring

All qualifications

Core experience

  • 7+ years of professional experience in software engineering and infrastructure engineering, with a track record of building and running distributed, cloud-native systems in production.
  • Experience taking technical ownership of a significant service or component, including design decisions on scalability, performance, and cost.
  • Hands-on experience building and maintaining AI/ML infrastructure in production, including model deployment and lifecycle management, for users outside your own team.
  • Hands-on experience taking LLM-based systems to production, including RAG architecture, retrieval and embedding design, prompt and model versioning, and tool or function calling.
  • Experience building security into a multi-tenant platform, including authorization boundaries between tenants and handling of sensitive data such as PII and PHI, with awareness of LLM-specific risks such as prompt injection and tool abuse.
  • Experience treating AI evaluation as a release gate rather than after-the-fact reporting, including eval harnesses, regression gates, and drift or quality monitoring for non-deterministic systems.
Qualification wording
7+ years of professional experience in software engineering and infrastructure engineering, with a track record of building and running distributed, cloud-native systems in production.
Experience taking technical ownership of a significant service or component, including design decisions on scalability, performance, and cost.
Hands-on experience building and maintaining AI/ML infrastructure in production, including model deployment and lifecycle management, for users outside your own team. Candidates whose experience is limited to building pipelines for their own team will not be a fit.
Hands-on experience taking LLM-based systems to production, including RAG architecture, retrieval and embedding design, prompt and model versioning, and tool or function calling. Prototyping with an SDK is not enough. We are looking for someone who has operated these systems under real traffic, real latency budgets, and real failure modes.
Experience building security into a multi-tenant platform, including authorization boundaries between tenants and handling of sensitive data such as PII and PHI, with awareness of LLM-specific risks such as prompt injection and tool abuse.
Experience treating AI evaluation as a release gate rather than after-the-fact reporting, including eval harnesses, regression gates, and drift or quality monitoring for non-deterministic systems.

Benefits in the posting

Full benefits wording
  • Competitive compensation
  • Stock options in a VC-backed Series C company
  • 100% employer-paid benefits for all eligible employees and immediate family members
  • 401(k)
  • Unlimited paid time off (PTO)

From the employer’s posting.

Apply at TetraScience

Posting record

Report an error

Actively hiringFirst seen by us 11 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 11, 202611 days ago
Recorded sightings
11
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$170K–$220K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 11

Similar jobs usually come down between day 7 and day 76.

At TetraScience, jobs usually come down by about day 52.

From 6,398 similar postings that came down, and 5 of TetraScience’s. Coming down is not always a hire.

TetraScience is hiring

12 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
  • 8% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • TypeScript
  • AWS
  • Databricks
  • Docker
  • MLflow
Where the posting names them
- Experience building security into a multi-tenant platform, including authorization boundaries between tenants and handling of sensitive data such as PII and PHI, with awareness of LLM-specific risks such as prompt injection and tool abuse. - Strong coding skills in TypeScript and Python for building reliable APIs and backend services, with the judgment to review AI-generated code for correctness, security, and fit. - Production experience with a model registry and serving stack, ideally Databricks MLflow, including model registration, versioning, asset bundles, and serving workflows.
- Design, build, and operate the services and APIs that let customers run models and agents against their own scientific data, and that Applied AI and data engineering teams build against internally. - Own the model and prompt lifecycle in your area across Databricks MLflow and AWS Bedrock, including registration, versioning, asset bundles, staged promotion, rollback, and multi-model serving. - Build the inference path for real-time and batch AI workloads, including routing, batching, caching, concurrency control, capacity planning, handling of large binary inputs such as instrument images, and graceful degradation under load.
- Build for the reproducibility and lineage a validated pharma environment requires: versioned data, code, prompts, and model artifacts, with an audit trail that holds up to customer and regulatory review. - Write infrastructure-as-code and deployment automation (CloudFormation, AWS CDK) for the services you own, working with the team that owns production deployments to support multi-tenant infrastructure, online upgrades, and on-demand compute. - Own production readiness for your services with Applied AI engineers, data engineers, and platform teams: performance, reliability, and cost of models in production, plus incident response and runbooks.
- Experience designing APIs with REST and OpenAPI that are scalable, secure, versioned, and extensible. - Working knowledge of AWS and containerized workloads (for example Docker), and familiarity with infrastructure-as-code such as CloudFormation or CDK, with the ability to contribute to CI/CD pipelines and deployment automation. - Experience with observability and SLI/SLO practice for production systems, including monitoring, alerting, and distributed tracing.
- Strong coding skills in TypeScript and Python for building reliable APIs and backend services, with the judgment to review AI-generated code for correctness, security, and fit. - Production experience with a model registry and serving stack, ideally Databricks MLflow, including model registration, versioning, asset bundles, and serving workflows. - Experience treating AI evaluation as a release gate rather than after-the-fact reporting, including eval harnesses, regression gates, and drift or quality monitoring for non-deterministic systems.

Your next step

Complete your application on apply.workable.com. The employer’s form will show what is required.

Applying through Workable

  • No account needed. You can import your resume to fill in the form, or skip that and fill it in yourself.

Already applied? Track this application

Job description

View original posting ↗

TetraScience is building the scientific data and AI cloud for biopharma. The platform is the innermost foundation for developing, delivering and operating our enterprise grade, secure, compliant Scientific Data and AI capabilities customers rely on.

We are looking for a Senior Software Platform Engineer who works at the intersection of distributed systems and MLOps. You will build and run key parts of our AI and data infrastructure, which our customers build their science on and which every other engineering team builds against. You will work closely with Applied AI engineers, data engineers, and platform teams to deliver the cloud services and MLOps infrastructure behind production-grade AI/ML workflows. You will own major parts of the AI platform end to end, from design through production. You will work with the Lead Platform Engineer and Applied AI teams on how the pieces fit together, and help shape the platform’s direction through design reviews. The work covers the model and prompt lifecycle, evaluation and observability, tenant and data boundaries around prompts and retrieval, and the cost and latency controls that keep production AI economical at scale.

This is a high-impact seat for an engineer who has shipped AI/ML infrastructure that real external users depend on, not only internal tooling. The model serving, MCP, and agent capabilities you build are used directly by scientists at the world's largest pharmaceutical companies, running against their own data under their compliance obligations. If that scope appeals to you, and you want to turn ambitious scalability and cost targets into working systems inside a regulated environment, we'd love to talk to you.

What You Will Do

  • Design, build, and operate the services and APIs that let customers run models and agents against their own scientific data, and that Applied AI and data engineering teams build against internally.
  • Own the model and prompt lifecycle in your area across Databricks MLflow and AWS Bedrock, including registration, versioning, asset bundles, staged promotion, rollback, and multi-model serving.
  • Build the inference path for real-time and batch AI workloads, including routing, batching, caching, concurrency control, capacity planning, handling of large binary inputs such as instrument images, and graceful degradation under load.
  • Integrate LLMs into production systems using retrieval-augmented generation (RAG), and build agent capabilities such as tool and function calling, MCP-based tooling, and agent runtimes.
  • Build security into the platform with our security team, including guardrails, prompt-injection and tool-abuse defenses, PII and PHI handling, and hard tenant data boundaries across prompts, retrieval, and tool calls.
  • Build the evaluation and quality tooling that makes AI shippable: offline and online eval harnesses, golden datasets, regression gates in CI, A/B and shadow deployment, and drift and hallucination detection in production.
  • Set up monitoring, alerting, logging, and distributed tracing for the services you own, and define SLIs and SLOs that make sense for systems whose outputs are probabilistic.
  • Build for the reproducibility and lineage a validated pharma environment requires: versioned data, code, prompts, and model artifacts, with an audit trail that holds up to customer and regulatory review.
  • Write infrastructure-as-code and deployment automation (CloudFormation, AWS CDK) for the services you own, working with the team that owns production deployments to support multi-tenant infrastructure, online upgrades, and on-demand compute.
  • Own production readiness for your services with Applied AI engineers, data engineers, and platform teams: performance, reliability, and cost of models in production, plus incident response and runbooks.
  • Take part in design reviews, write the design docs and technical documentation for your components, and mentor mid-level engineers.
  • Evaluate new frameworks, serving runtimes, and model providers, and bring clear build-versus-buy recommendations.

Requirements

  • 7+ years of professional experience in software engineering and infrastructure engineering, with a track record of building and running distributed, cloud-native systems in production.
  • Experience taking technical ownership of a significant service or component, including design decisions on scalability, performance, and cost.
  • Hands-on experience building and maintaining AI/ML infrastructure in production, including model deployment and lifecycle management, for users outside your own team. Candidates whose experience is limited to building pipelines for their own team will not be a fit.
  • Hands-on experience taking LLM-based systems to production, including RAG architecture, retrieval and embedding design, prompt and model versioning, and tool or function calling. Prototyping with an SDK is not enough. We are looking for someone who has operated these systems under real traffic, real latency budgets, and real failure modes.
  • Experience building security into a multi-tenant platform, including authorization boundaries between tenants and handling of sensitive data such as PII and PHI, with awareness of LLM-specific risks such as prompt injection and tool abuse.
  • Strong coding skills in TypeScript and Python for building reliable APIs and backend services, with the judgment to review AI-generated code for correctness, security, and fit.
  • Production experience with a model registry and serving stack, ideally Databricks MLflow, including model registration, versioning, asset bundles, and serving workflows.
  • Experience treating AI evaluation as a release gate rather than after-the-fact reporting, including eval harnesses, regression gates, and drift or quality monitoring for non-deterministic systems.
  • Experience designing APIs with REST and OpenAPI that are scalable, secure, versioned, and extensible.
  • Working knowledge of AWS and containerized workloads (for example Docker), and familiarity with infrastructure-as-code such as CloudFormation or CDK, with the ability to contribute to CI/CD pipelines and deployment automation.
  • Experience with observability and SLI/SLO practice for production systems, including monitoring, alerting, and distributed tracing.
  • Clear communication with customers and cross-functional teams, and the ability to influence technical direction on teams you do not manage.

Benefits

  • Competitive compensation
  • Stock options in a VC-backed Series C company
  • 100% employer-paid benefits for all eligible employees and immediate family members
  • 401(k)
  • Unlimited paid time off (PTO)
  • Flexible working arrangements
  • Company-paid Life Insurance, LTD/STD

No visa sponsorship is available for this position

The salary range for this position is $170,000-$220,000 USD. The salary range posted reflects our target baseline for this role. Final compensation is determined by a thorough evaluation of factors including the candidate’s specific experience, localized market data, and internal team equity.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
No visa sponsorship is available for this position The salary range for this position is $170,000-$220,000 USD. The salary range posted reflects our target baseline for this role. Final compensation is determined by a thorough evaluation of factors including the candidate’s specific experience, localized market data, and internal team equity.
Location & working pattern

San Mateo, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization
- Company-paid Life Insurance, LTD/STD No visa sponsorship is available for this position The salary range for this position is $170,000-$220,000 USD. The salary range posted reflects our target baseline for this role. Final compensation is determined by a thorough evaluation of factors including the candidate’s specific experience, localized market data, and internal team equity.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.