Back to jobs

Machine Learning Infrastructure Tech Lead

San Francisco Office · San Francisco, California, United States

Open 4 months, first seen by us 122 days ago
Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering — team source
Department: Engineering
From the employer’s posting

What you’ll work on

Full posting
  • Own technical direction and roadmap for ML infrastructure

  • Build and maintain training and inference stack

  • Optimize model serving across kernels, batching, and scheduling

  • Design reliable multi-node, multi-GPU training and inference systems

  • Build benchmarks to find bottlenecks and guide investments

From the employer’s posting
Own the technical direction and roadmap for Reducto's ML infrastructure.
Build and maintain our training and inference stack
Optimize model serving at every layer, including kernels, runtimes, batching, scheduling, and distributed inference.
Design systems for reliable multi-node, multi-GPU training and inference.
Develop benchmarks that identify bottlenecks and guide infrastructure investments.

What you’ll bring

All qualifications

Core experience

  • 5+ years building production infrastructure, including ML systems
  • Strong Python and systems-engineering skills
  • Comfortable with Kubernetes and distributed training or serving frameworks
  • Understands performance of modern GPU training or inference workloads
  • Has led complex technical projects from ambiguous problem to production
Qualification wording
5+ years of experience building production infrastructure, including significant ML systems experience.
Have strong Python and systems-engineering skills.
Are comfortable with Kubernetes and distributed training or serving frameworks.
Understand the performance characteristics of modern GPU training or inference workloads.
Have led complex technical projects from an ambiguous problem through production deployment.

Benefits in the posting

Full benefits wording
  • Unlimited PTO, because great work requires recharging.
  • Commuter Reimbursement, we’ll cover your transportation costs.
  • Comprehensive Insurance, medical, dental, and vision.
  • Health and Wellness Budget, up to $150 per month for wellness spending such as gym memberships or fitness classes.
  • Parental Leave, flexible scheduling that works for you and your family.Working at Reducto
  • This is an in-person role at our San Francisco office. We're an early-stage company, which means the role requires working hard and moving quickly. Please only apply if that excites you.

From the employer’s posting.

About Reducto

We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows.

In the employer’s words · Read in context · Company website ↗

Apply at Reducto

Posting record

Report an error

Open 4 monthsWe first saw this posting 122 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jul 19, 2026122 days ago
Recorded sightings
118
Last seen by us
Nov 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,507 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 122

Up longer than most. Similar jobs usually come down between day 7 and day 75.

From 5,846 similar postings that came down. Coming down is not always a hire.

Reducto is hiring

7 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Kubernetes
  • PyTorch
Where the posting names them
- Are equally comfortable setting direction and personally implementing the hardest parts. - Have strong Python and systems-engineering skills. - Understand the performance characteristics of modern GPU training or inference workloads.
This is a deeply hands-on role: roughly 80% of your time will be spent building, debugging, and optimizing our infrastructure. The remaining 20% will focus on setting technical direction - identifying bottlenecks, planning our infrastructure roadmap, and helping the ML and Platform teams make strong architectural decisions. You'll work across the stack, from model-serving kernels and GPU utilization to distributed systems and Kubernetes. We're looking for someone with the experience and judgment to lead ambiguous, high-impact infrastructure projects while remaining close to the code. This is a fully in-person role at our San Francisco office.
- Understand the performance characteristics of modern GPU training or inference workloads. - Are comfortable with Kubernetes and distributed training or serving frameworks. - Can reason across low-level model performance and higher-level platform architecture.
- Have optimized or implemented CUDA, Triton, or custom model-serving kernels. - Have contributed meaningfully to frameworks such as vLLM, SGLang, PyTorch, TensorRT-LLM, Ray, or related open-source systems. - Have operated distributed inference or training across hundreds or thousands of GPUs.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Reducto

Reducto is the agentic document platform for leading AI teams who demand enterprise performance at scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows.

We’ve grown rapidly, increasing revenue 8x year over year and partnering with hundreds of companies, from leading AI teams like Harvey, Vanta, and Scale, to enterprise customers across FAANG and top trading firms.

Reducto has raised over $100M from world-class investors including a16z, Benchmark, and First Round Capital.

The Opportunity

As our ML Infrastructure Tech Lead, you'll own the systems that make high-performance model training and inference possible at Reducto.

This is a deeply hands-on role: roughly 80% of your time will be spent building, debugging, and optimizing our infrastructure. The remaining 20% will focus on setting technical direction - identifying bottlenecks, planning our infrastructure roadmap, and helping the ML and Platform teams make strong architectural decisions.

You'll work across the stack, from model-serving kernels and GPU utilization to distributed systems and Kubernetes. We're looking for someone with the experience and judgment to lead ambiguous, high-impact infrastructure projects while remaining close to the code.

This is a fully in-person role at our San Francisco office.

What You'll Do

  • Own the technical direction and roadmap for Reducto's ML infrastructure.

  • Build and maintain our training and inference stack, balancing fast experimentation with high-performance production serving.

  • Optimize model serving at every layer, including kernels, runtimes, batching, scheduling, and distributed inference.

  • Design systems for reliable multi-node, multi-GPU training and inference.

  • Improve GPU utilization, latency, throughput, reliability, observability, and cost efficiency.

  • Develop benchmarks that identify bottlenecks and guide infrastructure investments.

  • Evaluate state-of-the-art advances in training and inference and apply the ones that matter.

  • Build the tooling and abstractions that help ML engineers move quickly from experiments to production.

  • Partner with ML and Platform engineers on architecture, capacity planning, and technical prioritization.

  • Raise the engineering bar through design reviews, mentorship, and hands-on technical leadership.

You'll Thrive Here If You

  • Have 5+ years of experience building production infrastructure, including significant ML systems experience.

  • Have led complex technical projects from an ambiguous problem through production deployment.

  • Are equally comfortable setting direction and personally implementing the hardest parts.

  • Have strong Python and systems-engineering skills.

  • Understand the performance characteristics of modern GPU training or inference workloads.

  • Are comfortable with Kubernetes and distributed training or serving frameworks.

  • Can reason across low-level model performance and higher-level platform architecture.

  • Hold yourself to a high bar for quality, precision, and operational reliability.

  • Operate well in a fast-changing, high-growth environment.

  • Take full ownership from strategy through execution.

Bonus Points If You

  • Have optimized or implemented CUDA, Triton, or custom model-serving kernels.

  • Have contributed meaningfully to frameworks such as vLLM, SGLang, PyTorch, TensorRT-LLM, Ray, or related open-source systems.

  • Have operated distributed inference or training across hundreds or thousands of GPUs.

  • Have built observability, scheduling, or capacity-management systems for GPU workloads.

  • Have experience at an early-stage or high-growth startup.

  • Care deeply about connecting technical excellence to measurable business impact.

Why Reducto

  • Impact: Your work directly shapes how the world’s best AI companies access and use enterprise data.

  • Speed: We move fast, ship often, and iterate in days, not months.

  • Learning: Work alongside world-class engineers, operators, and founders who care deeply about product, precision, and velocity.

Benefits

  • Unlimited PTO, because great work requires recharging.

  • Daily Lunch, enjoy free lunch with teammates in the office.

  • Commuter Reimbursement, we’ll cover your transportation costs.

  • Comprehensive Insurance, medical, dental, and vision.

  • Health and Wellness Budget, up to $150 per month for wellness spending such as gym memberships or fitness classes.

  • Parental Leave, flexible scheduling that works for you and your family.Working at Reducto

This is an in-person role at our San Francisco office. We're an early-stage company, which means the role requires working hard and moving quickly. Please only apply if that excites you.

Equal Opportunity
Reducto is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration without regard to sex, race, color, age, national origin, religion, disability, sexual orientation, gender identity, veteran status, or any other protected category.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

San Francisco, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.