Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
San Francisco Office · San Francisco, California, United States
Open 4 months, first seen by us 122 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
Own technical direction and roadmap for ML infrastructure
Build and maintain training and inference stack
Optimize model serving across kernels, batching, and scheduling
Design reliable multi-node, multi-GPU training and inference systems
Build benchmarks to find bottlenecks and guide investments
Own the technical direction and roadmap for Reducto's ML infrastructure.
Build and maintain our training and inference stack
Optimize model serving at every layer, including kernels, runtimes, batching, scheduling, and distributed inference.
Design systems for reliable multi-node, multi-GPU training and inference.
Develop benchmarks that identify bottlenecks and guide infrastructure investments.
5+ years of experience building production infrastructure, including significant ML systems experience.
Have strong Python and systems-engineering skills.
Are comfortable with Kubernetes and distributed training or serving frameworks.
Understand the performance characteristics of modern GPU training or inference workloads.
Have led complex technical projects from an ambiguous problem through production deployment.
From the employer’s posting.
We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows.
In the employer’s words · Read in context · Company website ↗
Open 4 monthsWe first saw this posting 122 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Day 122
Up longer than most. Similar jobs usually come down between day 7 and day 75.
From 5,846 similar postings that came down. Coming down is not always a hire.
7 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Are equally comfortable setting direction and personally implementing the hardest parts. - Have strong Python and systems-engineering skills. - Understand the performance characteristics of modern GPU training or inference workloads.
This is a deeply hands-on role: roughly 80% of your time will be spent building, debugging, and optimizing our infrastructure. The remaining 20% will focus on setting technical direction - identifying bottlenecks, planning our infrastructure roadmap, and helping the ML and Platform teams make strong architectural decisions. You'll work across the stack, from model-serving kernels and GPU utilization to distributed systems and Kubernetes. We're looking for someone with the experience and judgment to lead ambiguous, high-impact infrastructure projects while remaining close to the code. This is a fully in-person role at our San Francisco office.
- Understand the performance characteristics of modern GPU training or inference workloads. - Are comfortable with Kubernetes and distributed training or serving frameworks. - Can reason across low-level model performance and higher-level platform architecture.
- Have optimized or implemented CUDA, Triton, or custom model-serving kernels. - Have contributed meaningfully to frameworks such as vLLM, SGLang, PyTorch, TensorRT-LLM, Ray, or related open-source systems. - Have operated distributed inference or training across hundreds or thousands of GPUs.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Reducto is the agentic document platform for leading AI teams who demand enterprise performance at scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows.
We’ve grown rapidly, increasing revenue 8x year over year and partnering with hundreds of companies, from leading AI teams like Harvey, Vanta, and Scale, to enterprise customers across FAANG and top trading firms.
Reducto has raised over $100M from world-class investors including a16z, Benchmark, and First Round Capital.
As our ML Infrastructure Tech Lead, you'll own the systems that make high-performance model training and inference possible at Reducto.
This is a deeply hands-on role: roughly 80% of your time will be spent building, debugging, and optimizing our infrastructure. The remaining 20% will focus on setting technical direction - identifying bottlenecks, planning our infrastructure roadmap, and helping the ML and Platform teams make strong architectural decisions.
You'll work across the stack, from model-serving kernels and GPU utilization to distributed systems and Kubernetes. We're looking for someone with the experience and judgment to lead ambiguous, high-impact infrastructure projects while remaining close to the code.
This is a fully in-person role at our San Francisco office.
Own the technical direction and roadmap for Reducto's ML infrastructure.
Build and maintain our training and inference stack, balancing fast experimentation with high-performance production serving.
Optimize model serving at every layer, including kernels, runtimes, batching, scheduling, and distributed inference.
Design systems for reliable multi-node, multi-GPU training and inference.
Improve GPU utilization, latency, throughput, reliability, observability, and cost efficiency.
Develop benchmarks that identify bottlenecks and guide infrastructure investments.
Evaluate state-of-the-art advances in training and inference and apply the ones that matter.
Build the tooling and abstractions that help ML engineers move quickly from experiments to production.
Partner with ML and Platform engineers on architecture, capacity planning, and technical prioritization.
Raise the engineering bar through design reviews, mentorship, and hands-on technical leadership.
Have 5+ years of experience building production infrastructure, including significant ML systems experience.
Have led complex technical projects from an ambiguous problem through production deployment.
Are equally comfortable setting direction and personally implementing the hardest parts.
Have strong Python and systems-engineering skills.
Understand the performance characteristics of modern GPU training or inference workloads.
Are comfortable with Kubernetes and distributed training or serving frameworks.
Can reason across low-level model performance and higher-level platform architecture.
Hold yourself to a high bar for quality, precision, and operational reliability.
Operate well in a fast-changing, high-growth environment.
Take full ownership from strategy through execution.
Have optimized or implemented CUDA, Triton, or custom model-serving kernels.
Have contributed meaningfully to frameworks such as vLLM, SGLang, PyTorch, TensorRT-LLM, Ray, or related open-source systems.
Have operated distributed inference or training across hundreds or thousands of GPUs.
Have built observability, scheduling, or capacity-management systems for GPU workloads.
Have experience at an early-stage or high-growth startup.
Care deeply about connecting technical excellence to measurable business impact.
Impact: Your work directly shapes how the world’s best AI companies access and use enterprise data.
Speed: We move fast, ship often, and iterate in days, not months.
Learning: Work alongside world-class engineers, operators, and founders who care deeply about product, precision, and velocity.
Benefits
Unlimited PTO, because great work requires recharging.
Daily Lunch, enjoy free lunch with teammates in the office.
Commuter Reimbursement, we’ll cover your transportation costs.
Comprehensive Insurance, medical, dental, and vision.
Health and Wellness Budget, up to $150 per month for wellness spending such as gym memberships or fitness classes.
Parental Leave, flexible scheduling that works for you and your family.Working at Reducto
This is an in-person role at our San Francisco office. We're an early-stage company, which means the role requires working hard and moving quickly. Please only apply if that excites you.
Equal Opportunity
Reducto is an Equal Opportunity Employer committed to diversity and inclusion in the workplace. All qualified applicants will receive consideration without regard to sex, race, color, age, national origin, religion, disability, sexual orientation, gender identity, veteran status, or any other protected category.
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.