Back to jobs

Engineering Manager, ML Training Infrastructure

Pay
$140,000–260,000/year · Base — pay source
English/Japanese bilingual ability The base pay for this position ranges from $140,000 - $260,000 a year. Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.
Read the full posting
Work setting
Hybrid — work setting source
Work setup in the employer’s posting: hybrid
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • Manage and mentor a group of around 7–8 engineers

  • Build and maintain Kubernetes compute clusters for ML workloads

  • Optimize GPU fleet scheduling, utilization, stability and cost

  • Advance distributed training with Ray and workflow tools like Airflow and Temporal

  • Lead post-incident reviews and production support workflows

From the employer’s posting
Manage and nurture a group of around 7–8 engineers
Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.
Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.
Engage in production support workflows, lead post-incident reviews

What you’ll bring

All qualifications

Core experience

  • 8+ years of software engineering experience
  • At least 2 years in a leadership role
  • Proven track record mentoring and managing high-performing software or platform teams
Qualification wording
8+ years of experience in software engineering
with at least 2 years in a leadership role
Proven track record mentoring and managing high-performing software or platform te

Benefits in the posting

Full benefits wording
  • ・Excellent health, wellness, dental and vision coverage
  • ・A rewarding 401k program
  • Our Commitment

From the employer’s posting.

Apply at Woven by Toyota

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 30, 202648 days ago
Recorded sightings
55
Last seen by us
Nov 17, 2026
Employer says posted
Sep 28, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$140K–$260K against $155K–$227K, the middle half of what similar US postings state.

From 3,212 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 48

Similar jobs usually come down between day 8 and day 57.

At Woven by Toyota, jobs usually come down by about day 79.

From 9,619 similar postings that came down, and 18 of Woven by Toyota’s. Coming down is not always a hire.

Woven by Toyota is hiring

17 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Go
  • Kubernetes
  • Airflow
Where the posting names them
- Experience working with Japanese customers or clients. - Experience with Golang development (especially for cloud services) - Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).
The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies. The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal. We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform.
You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use. This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads. You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform.
- Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads. - Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads. - Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.
- Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure. - Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems. - Hands-on exposure to cloud platform architectures and highly resilient distributed systems.
- Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools. - Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks. - Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

Woven by Toyota is enabling Toyota’s once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what “mobility” means and how it serves society.

Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we’re working toward one bold goal: a world with zero accidents and enhanced well-being for all.

About the Team

Enterprise AI is a platform that provides end-to-end machine learning tooling experience to support and accelerate machine learning development, including autonomous driving and other related projects. Our platform serves customers as a standardized machine learning platform within Woven by Toyota as the larger Toyota Group companies.

The Enterprise AI ML Training Infrastructure team builds and operates the infrastructure that enables engineers and researchers to train, evaluate, and iterate on machine learning models at scale. Our customers include teams working on AD/ADAS and Woven City, where large-scale machine learning workloads, simulation, and data processing are critical to developing the next generation of mobility technologies.

The team operates at the intersection of machine learning, distributed systems, cloud infrastructure, and developer platforms. Our systems include large-scale GPU compute environments, Kubernetes-based cluster infrastructure, and workflow and pipeline orchestration technologies such as Ray, Airflow, and Temporal.

We are looking for an Engineering Manager to lead a team to help shape the technical direction, engineering culture, and long-term evolution of our ML training infrastructure platform.

 

WHO ARE WE LOOKING FOR?

As the Engineering Manager, ML Training Infrastructure, you will lead the team responsible for building and operating the infrastructure that powers machine learning training workloads across Woven by Toyota.

You will combine engineering leadership with strong technical judgment. You will work closely with engineering, research, and product stakeholders to understand customer needs, translate them into scalable technical solutions, and ensure that our platform is reliable, efficient, secure, and easy to use.

This role is particularly suited to an engineering leader who enjoys working on complex infrastructure problems and is comfortable operating across Kubernetes, distributed systems, GPU infrastructure, cloud platforms, and machine learning workloads.

You will also play an important role in building a strong engineering culture, developing engineers, establishing effective engineering practices, and partnering with our customers to continuously improve the platform.

 

What You Will Enable

In this role, you will help build the infrastructure that enables teams across Woven by Toyota to train and operate increasingly large and sophisticated machine learning workloads.

Your work will directly support engineers and researchers working on AD/ADAS, Woven City, and other mobility initiatives by making compute resources easier to access, workloads more reliable, and ML development faster and more scalable.

You will have the opportunity to shape both the technical architecture of a critical ML infrastructure platform and the engineering culture of the team building it.

RESPONSIBILITIES

  • Lead engineers and foster a collaborative and innovative environment.

  • Manage and nurture a group of around 7–8 engineers, offering technical vision, mentorship, professional growth, and effective project delivery.

  • Establish and articulate the technical vision and future roadmap for machine learning training infrastructure.

  • Direct the architecture, construction, and operation of resilient systems supporting massive ML model training workloads.

  • Construct and maintain Kubernetes-driven compute clusters and container ecosystems tailored for machine learning workloads.

  • Oversee and optimize GPU fleets, addressing cluster scheduling, resource utilization, system stability, and cost performance.

  • Advance distributed model training capabilities and workload management leveraging frameworks like Ray and adjacent tools.

  • Enhance workflow orchestration platforms by deploying and supporting solutions such as Airflow, Temporal, and similar pipeline frameworks.

  • Elevate the system resilience, monitoring insights, elasticity, and operational productivity of our ML training stack.

  • Work closely alongside AD/ADAS, Woven City, and internal platform partners to gather feature requests and ship infrastructure solutions that accelerate development.

  • Partner with cross-functional engineering groups to specify platform interfaces, APIs, system architectures, and operational standards.

  • Translate high-level organizational objectives and user requirements into concrete, executable engineering milestones with product leads.

  • Institute rigorous software practices across implementation, code reviews, automated testing, continuous deployment, and live site management.

  • Engage in production support workflows, lead post-incident reviews, and champion system refinements based on operational findings.

  • Balance immediate client feature requests against long-term architectural stability, technical hygiene, and system maintainability.

  • Foster an inclusive, highly collaborative, and excellence-driven engineering culture throughout Woven by Toyota.

MINIMUM QUALIFICATIONS

  • 8+ years of experience in software engineering, with at least 2 years in a leadership role.

  • Proven track record mentoring and managing high-performing software or platform teams.

  • Demonstrated expertise in architecting, deploying, and maintaining large-scale mission-critical infrastructure.

  • Deep technical mastery of Kubernetes orchestration alongside containerized runtime systems.

  • Hands-on exposure to cloud platform architectures and highly resilient distributed systems.

  • Background engineering platform foundation layers designed for machine learning model development or data pipeline intensive workloads.

  • Practical understanding of massive GPU cluster management, hardware scheduling algorithms, and capacity efficiency tuning.

  • Operational background overseeing high-availability environments, leading post-incident reviews, and advancing monitoring capabilities.

  • Excellent interpersonal abilities to align technical roadmaps across diverse engineering partners and leadership stakeholders.

NICE TO HAVES

  • Experience working with Japanese customers or clients.

  • Experience with Golang development (especially for cloud services)

  • Experience in the automotive industry or knowledge of automotive software development (e.g., ASPICE, V-model).

  • Experience working in environments with a focus on security and safety.

  • English/Japanese bilingual ability

The base pay for this position ranges from $140,000 - $260,000 a year.

Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.

WHAT WE OFFER
We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best programs to allow you to do your most meaningful work and to help you shape the future of mobility.
・Excellent health, wellness, dental and vision coverage
・A rewarding 401k program
・Flexible vacation policy
・Family planning and care benefits

Our Commitment
・We are an equal opportunity employer and value diversity.
・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.

Employment type

Employee

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 752, the most 1,165, and the latest week had 796.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
English/Japanese bilingual ability The base pay for this position ranges from $140,000 - $260,000 a year. Your base salary is one part of your total compensation. We offer a base salary, short term and long term incentives, and a comprehensive benefits package. The total compensation offered to an employee will be dependent upon the individual's skills, experience, qualifications, location, and level.
Location & working pattern

Palo Alto, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.