Back to jobs

Engineering Manager, ML Performance Optimization

Pay
USD 276,000–343,000/year — pay source
Salary 276,000 – 343,000 USD per year About Zoox
Read the full posting
Work setting
Hybrid — work setting source
Work setup in the employer’s posting: hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type Full-time
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Drive end-to-end performance optimization for large-scale model training and inference

  • Build and run the ML platform for training, serving, and monitoring models

  • Deliver low-latency on-vehicle inference within real-time and compute budgets

  • Develop and execute the ML training and inference performance roadmap

  • Hire and mentor engineers, giving them growth opportunities and clear feedback

From the employer’s posting
Drive end-to-end performance optimization for large-scale model training and inference
Lead the design, implementation, and operation of a robust and efficient ML platform to enable the training, validation, serving, optimization and monitoring of ML models.
low-latency on-vehicle inference that meets strict real-time and compute budgets
Develop and execute a strategic vision and roadmap for ML Training and Inference Performance Optimization
Enable engineers on the team to grow their careers by providing the right opportunities and clear, timely feedback.

Before you apply

Employer’s visa record
31,079 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • 8+ years of relevant experience, including 3+ years of management experience managing engineers.
  • Experience building user-friendly ML Infrastructure that enabled large-scale model training and high-throughput, low-latency serving use cases.
  • Experience with training frameworks like PyTorch, JAX, etc., leveraging GPUs for distributed model training.
  • Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.
Qualification wording
8+ years of relevant experience, including 3+ years of management experience managing engineers.
Experience building user-friendly ML Infrastructure that enabled large-scale model training and high-throughput, low-latency serving use cases.
Experience with training frameworks like PyTorch, JAX, etc., leveraging GPUs for distributed model training.
Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.

About Zoox

Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market.

In the employer’s words · Read in context

Apply at Zoox

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 7, 202646 days ago
Recorded sightings
76
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$276K–$343K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 46

Similar jobs usually come down between day 7 and day 76.

At Zoox, jobs usually come down by about day 75.

From 6,398 similar postings that came down, and 25 of Zoox’s. Coming down is not always a hire.

Zoox is hiring

23 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
  • 4% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • PyTorch
Where the posting names them
- Experience building user-friendly ML Infrastructure that enabled large-scale model training and high-throughput, low-latency serving use cases. - Experience with training frameworks like PyTorch, JAX, etc., leveraging GPUs for distributed model training. - Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

Zoox is on a mission to reimagine transportation and build autonomous robotaxis from the ground up that are safe, reliable, clean, and enjoyable for everyone. With bidirectional driving capabilities and four-wheel steering, our vehicle allows us to maneuver through compact spaces and change directions without needing to reverse. We are at a critical inflection point as we scale our robotaxi deployment, and it is a great time to join Zoox and have a significant impact on executing our mission. 
 
Our growing ML performance engineering leadership team is looking for an Engineering Manager, ML Performance Optimization. The centralized ML performance team at Zoox plays a crucial role in enabling innovations across all our ML research teams to develop and deploy models across our robotaxi and cloud infrastructure and to advance cutting-edge training and inference optimization techniques.
 
The Opportunity
We are working on many interesting challenges to enable rapid experimentation and scale our multi-modal Foundation models and RL infrastructure, and ensure these models run efficiently on our vehicles, meeting our latency targets. You will get to work across all ML teams within Zoox - Perception, Prediction, Planner, Simulation and our Advanced Hardware Engineering group, and have the opportunity to significantly push the boundaries of ML scaling and acceleration at Zoox.
 
You will lead a team of strong ML performance engineers and this team has many growth opportunities as we expand our geofences at U.S markets and venture into new ML domains. If you want to learn more about our ML Infrastructure, here is one of our past talks at re:Invent.

In this role, you will:

  • Vision: Develop and execute a strategic vision and roadmap for ML Training and Inference Performance Optimization, ensuring scalability, reliability, and performance to support autonomous driving.

  • Technical acumen: Lead the design, implementation, and operation of a robust and efficient ML platform to enable the training, validation, serving, optimization and monitoring of ML models.

  • ML Performance Optimization: Drive end-to-end performance optimization for large-scale model training and inference, including distributed training efficiency, GPU utilization, memory and communication optimization, model compression (quantization, pruning, distillation), and low-latency on-vehicle inference that meets strict real-time and compute budgets.

  • Hiring: Attract, hire, and inspire a diverse world-class engineering team, fostering a culture of innovation, collaboration, and excellence.

  • Partnership: Collaborate closely with cross-functional teams, including ML researchers, software engineers, data engineers, and hardware engineers, to define requirements and align on architectural decisions.

  • Mentorship: Enable engineers on the team to grow their careers by providing the right opportunities and clear, timely feedback.

Qualifications

  • 8+ years of relevant experience, including 3+ years of management experience managing engineers.
  • Strong technical background in ML performance optimization, such as distributed training strategies (data, tensor, pipeline parallelism, FSDP/ZeRO), mixed-precision training, kernel-level optimization (CUDA, Triton), compiler stacks (torch.compile, XLA, TVM), quantization, and profiling/benchmarking across GPU and embedded accelerators.
  • Experience building user-friendly ML Infrastructure that enabled large-scale model training and high-throughput, low-latency serving use cases.
  • Experience with training frameworks like PyTorch, JAX, etc., leveraging GPUs for distributed model training.
  • Experience with GPU-accelerated inference using TensorRT, Ray Serve, or similar frameworks.
  • Proven track record of extensive cross-functional collaboration, partnering with research, product, hardware, and platform teams to align priorities, influence technical direction, and deliver measurable performance improvements across organizational boundaries.
Base Salary Range
 
There are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.
 
Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.

Salary

276,000 – 343,000 USD per year

About Zoox
Zoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.

Follow us on LinkedIn

Accommodations
If you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.

A Final Note:
You do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.

Employment type

Full-time

About Zoox

People
About 1,207,759 in 2024.Benefit plan filings (Form 5500)
Company
Listed as AMZN.
H-1B visas
6,217 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Layoff notices
Notices this year and last cover 2,978 people. The latest was filed November 2, 2026.State WARN notices

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Salary 276,000 – 343,000 USD per year About Zoox
Location & working pattern

Foster City, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.