Back to jobs

Machine Learning Infrastructure Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting

Every model 1001 ships depends on the platform you build.

You will make trained models production-ready by building infrastructure that is reliable, secure, and affordable to operate.

  • Build and operate ML serving infrastructure across customer deployments

  • Own the deployment pipeline, registries, artifacts, and multi-tenant serving

  • Build monitoring, logging, and observability for model performance

  • Improve inference latency, throughput, reliability, and cost on CPU and GPU

  • Maintain reusable platform components so product teams can deploy independently

From the employer’s posting
Every model 1001 ships depends on the platform you build. As an ML Infrastructure Engineer, you will own the serving, deployment, and observability layer supporting models across multiple enterprise and government deployments.
You will make trained models production-ready by building infrastructure that is reliable, secure, and affordable to operate. The work includes multi-tenant serving, model registries and artifacts, deployment security, and efficient inference across CPU and GPU workloads.
Build and operate ML serving infrastructure across multiple enterprise and government deployments.
Own the deployment pipeline, including model registries, artifacts, datasets, deployment security, and multi-tenant serving.
Build monitoring, logging, and observability systems that make model performance visible and surface problems early.
Improve inference latency, throughput, reliability, and cost across CPU and GPU workloads.
Maintain reusable platform components that allow product teams to deploy models without waiting for infrastructure support.

About 1001 Ai

1001 builds AI-powered operational intelligence for complex, data-heavy environments.

In the employer’s words · Read in context

Apply at 1001 Ai

Posting record

Report an error

Actively hiringFirst seen by us 8 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 10, 20268 days ago
Recorded sightings
8
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 8

Similar jobs usually come down between day 7 and day 75.

From 5,846 similar postings that came down. Coming down is not always a hire.

1001 Ai is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • TypeScript
  • AWS
  • Azure
  • GCP
  • Grafana
  • Kubernetes
  • Terraform
Where the posting names them
- Experience with monitoring and observability tools such as Prometheus, Grafana, or OpenTelemetry. - Strong Python and TypeScript skills. Nice to have
- Strong experience with Kubernetes, containers, CI/CD, and infrastructure as code using Terraform. - Production cloud experience with AWS, GCP, or Azure. - Experience with monitoring and observability tools such as Prometheus, Grafana, or OpenTelemetry.
- Production cloud experience with AWS, GCP, or Azure. - Experience with monitoring and observability tools such as Prometheus, Grafana, or OpenTelemetry. - Strong Python and TypeScript skills.
- Hands-on experience with a model serving stack such as Triton, TorchServe, Ray Serve, vLLM, BentoML, or KServe. - Strong experience with Kubernetes, containers, CI/CD, and infrastructure as code using Terraform. - Production cloud experience with AWS, GCP, or Azure.

Your next step

Complete your application on careers.1001.ai. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Back to all roles Machine Learning Infrastructure Engineer
Department Engineering
Location
  • London, United Kingdom
Type Full-time

Join the team

Build what comes next with us.

Bring your perspective, your craft, and your ambition. We’d love to hear how you could help 1001 move forward.

Apply for this role →

About 1001

1001 builds AI-powered operational intelligence for complex, data-heavy environments. We turn fragmented data into a live, unified model of operations, helping governments and large enterprises make better decisions and solve high-stakes problems.

Our engagements begin with forward-deployed teams working inside customer environments. These teams use real operational data, build quickly, and iterate until the system proves itself. We then scale the system across the organization.

1001 is backed by Lux Capital, General Catalyst, CIV, Hanabi, Sanabil, and 9Yards, along with angels including Chris Ré, Amjad Masad, Karim Atiyeh, Kareem Amin, and Russell Kaplan.

About the role

Every model 1001 ships depends on the platform you build. As an ML Infrastructure Engineer, you will own the serving, deployment, and observability layer supporting models across multiple enterprise and government deployments.

You will make trained models production-ready by building infrastructure that is reliable, secure, and affordable to operate. The work includes multi-tenant serving, model registries and artifacts, deployment security, and efficient inference across CPU and GPU workloads.

This is a hands-on role for someone who has operated machine learning systems in production. You will also build shared platform components that product teams can use independently, making each deployment faster and more reliable than the last.

What you'll work on

  • Build and operate ML serving infrastructure across multiple enterprise and government deployments.
  • Own the deployment pipeline, including model registries, artifacts, datasets, deployment security, and multi-tenant serving.
  • Build monitoring, logging, and observability systems that make model performance visible and surface problems early.
  • Improve inference latency, throughput, reliability, and cost across CPU and GPU workloads.
  • Maintain reusable platform components that allow product teams to deploy models without waiting for infrastructure support.
  • Establish consistent deployment practices across customer environments.

What we're looking for

  • At least 4 years of experience in infrastructure or platform engineering, including meaningful experience with ML infrastructure or MLOps.
  • A track record of operating machine learning systems in production, not only developing models.
  • Hands-on experience with a model serving stack such as Triton, TorchServe, Ray Serve, vLLM, BentoML, or KServe.
  • Strong experience with Kubernetes, containers, CI/CD, and infrastructure as code using Terraform.
  • Production cloud experience with AWS, GCP, or Azure.
  • Experience with monitoring and observability tools such as Prometheus, Grafana, or OpenTelemetry.
  • Strong Python and TypeScript skills.

Nice to have

  • Experience optimizing GPU workloads.
  • Experience with distributed training.
  • Experience serving large models in production.

Working at 1001

We take on high-stakes problems in environments where mistakes carry real consequences. That demands an uncompromising bar, real speed, and systems that hold up under live operations. The people who thrive set that bar for themselves and keep raising it. They own outcomes end to end, bring rigor to everything, and lift everyone around them.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

London, United Kingdom

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.