Back to jobs

Software Engineer: ML Infra

Boston (Somerville) · Somerville, Massachusetts, United States

Live, first seen by us 16 days ago
Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Technical Staff — team source
Department: Technical Staff
From the employer’s posting

What you’ll work on

Full posting

Generalist trains very large robot foundation models.

You will also own inference infrastructure.

  • Own and maintain the GPU compute fleets so researchers can use them easily

  • Maximize GPU utilization for distributed training and researcher experiments

  • Optimize ML data loading, transport and storage in distributed environments

  • Orchestrate inference fleets of GPUs attached to robots

From the employer’s posting
Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions.
You will also own inference infrastructure. For our robots this is a fleet of on-prem GPUs attached to robots that have extreme real-time and latency budgets in compute constrained environments.
Owning our GPU compute fleets
Ensure our GPUs are easy for researchers to use and maximally utilized
Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments.
Orchestration of robot inference fleets

What you’ll bring

All qualifications

Core experience

  • Experience managing large GPU fleets for distributed training or inference
  • Deep experience with Slurm or Kubernetes for ML workload orchestration
  • Experience building high-scale ML data loaders and preparation systems
  • Deep understanding of ML hardware, storage and networking stacks
  • Experience in the NVIDIA GPU ecosystem
Qualification wording
Have managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference
Deep experience in Slurm or Kubernetes for ML workload orchestration
Have build high-scale ML data loaders and preparation systems
Deeply understand every layer of the ML hardware, storage, and networking stacks
Have experience in the NVidia GPU ecosystem

About Generalist

We build embodied foundation models, starting with a focus on dexterity.

In the employer’s words · Read in context · Company website ↗

Apply at Generalist

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 5, 202616 days ago
Recorded sightings
17
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 16

Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Generalist is hiring

8 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Kubernetes
Where the posting names them
- Have managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference - Deep experience in Slurm or Kubernetes for ML workload orchestration - Have build high-scale ML data loaders and preparation systems

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Has Generalist posted this job before?

Yes. We’ve followed one other Software Engineer: ML Infra job there since August 2026. It is still up.

  1. San MateoStill up after 101 days, first seen Aug 12
  2. This jobUp 17 days so far, first seen Nov 5

Job description

View original posting ↗


About Generalist

At Generalist, we are on a mission to build general intelligence for the physical world and make it useful to everyone. We believe the industries and homes of the future will depend on humans and machines working together in new ways. Robots can help us build more and get more done.

We build embodied foundation models, starting with a focus on dexterity. This requires advancing the frontiers of data, models, and hardware, to enable robots to intelligently interact with the physical world.

The company embraces both large-scale AI and robotics as core to its DNA. Our team of researchers, roboticists, and company builders come from OpenAI, Boston Dynamics, Google DeepMind, and other frontier labs—with a track record of shipping AI breakthroughs. Before Generalist, we pioneered large embodied multimodal models and vision-language-action models (PaLM-E, RT-2, Gemini Robotics), launched and scaled ChatGPT and GPT-4 to hundreds of millions of users, engineered the foundations of autonomous driving, built next-generation robots (Atlas, Spot, Stretch) and pushed the limits of what they can do (from parkour to manipulation, and testing robustness).

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

About the Role

Generalist trains very large robot foundation models. This requires utilizing very large numbers of the latest generation GPU hardware and infrastructure (currently Nvidia) to run distributed training jobs and researcher experiments. We have extreme requirements on storage and data loading infrastructure that requires maximizing cloud infrastructure and custom solutions.

You will also own inference infrastructure. For our robots this is a fleet of on-prem GPUs attached to robots that have extreme real-time and latency budgets in compute constrained environments.

You’ll be responsible for:

  • Owning our GPU compute fleets

  • Ensure our GPUs are easy for researchers to use and maximally utilized

  • Optimizing and improving ML data loading transport and storage in highly distributed fully utilized environments.

  • Orchestration of robot inference fleets

You might thrive in this role if you:

  • Have managed large fleets of GPUs doing large-scale, long-term, highly distributed training runs or inference

  • Deep experience in Slurm or Kubernetes for ML workload orchestration

  • Have build high-scale ML data loaders and preparation systems

  • Deeply understand every layer of the ML hardware, storage, and networking stacks

  • Have experience in the NVidia GPU ecosystem

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Somerville, Massachusetts, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.