Back to jobs

ML Systems & Performance Engineer

San Francisco · San Francisco, California, United States

Open 3 months, first seen by us 101 days ago
Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Member of Technical Staff — team source
Department: Member of Technical Staff
From the employer’s posting

What you’ll work on

Full posting

You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and performance engineers in building our personalization and continual learning API, which powers models and agents that learn from user context.

This role is focused on designing, optimizing, and scaling training and inference workloads —bridging the gap between cutting-edge AI research and production.

  • Design and build frameworks and systems that improve performance, reliability, latency and efficiency

  • Turn researchers' prototypes into systems that run at scale

  • Optimize serving paths for personalization and memory retrieval

  • Work on distributed training across multiple GPUs and nodes

From the employer’s posting
You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and performance engineers in building our personalization and continual learning API, which powers models and agents that learn from user context.
This role is focused on designing, optimizing, and scaling training and inference workloads —bridging the gap between cutting-edge AI research and production. This includes:
Designing and executing new frameworks, techniques, and systems to improve performance, reliability, latency, and efficiency.
turning prototypes into systems that run at scale and feeding systems constraints back into research decisions
Optimize serving paths for personalization and memory retrieval, where per-user state and low latency both matter.
Work on distributed training — data and model parallelism, communication scheduling, and scaling efficiency across multiple GPUs and nodes.

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you require work sponsorship now and/or in the future?
From the employer’s application form
Education & alternatives
Your background looks like - Bachelor’s degree or equivalent experience in computer science, engineering, or similar. - 5+ years of experience with training or inference systems, optimized workloads with measurable results.

About Engram Lab

Today’s AI is a brilliant stranger: it can solve the world’s hardest math problems, but it knows next to nothing about you and your work.

In the employer’s words · Read in context · Company website ↗

Apply at Engram Lab

Posting record

Report an error

Open 3 monthsWe first saw this posting 101 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 12, 2026101 days ago
Recorded sightings
63
Last seen by us
Nov 21, 2026
Employer says posted
Jun 23, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 101

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,389 similar postings that came down. Coming down is not always a hire.

Engram Lab is hiring

1 open job

  • No new data jobs since August
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • PyTorch
Where the posting names them
- Strong engineering foundation, with demonstrated excellence navigating complex technical environments and shipping high-quality code in a fast-paced environment. - Deep understanding of ML framework (eg. PyTorch, JAX), GPUs, distributed systems, and infrastructure. - Operate well in ambiguous environments — you will have real ownership and be responsible for steering the ship in a novel sector of the industry.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Engram

Today’s AI is a brilliant stranger: it can solve the world’s hardest math problems, but it knows next to nothing about you and your work. It rereads your files to answer even basic questions, burns an enormous amount of tokens when sifting through large corpuses, and between sessions, it retains scraps at best.

We train models to study your world and anticipate your questions in advance, forming engrams: compact memories that capture your knowledge and history. Our approach opens a new axis of scaling. The more we study your context at training time, the better we become at inference time.

We're already working with leaders in AI like Microsoft, Notion, and Harvey, and just raised $98M from General Catalyst, Kleiner Perkins, Sequoia, Factory, Modern, Amplify, Neo and others. Our investors and advisors include Assaf Rappaport, Andrej Karpathy, and Pieter Abbeel.

AI has spent years learning everything about the world. Now it should learn something about yours.

About this role

You’ll be among the first ML Systems Engineer, joining a team of machine learning researchers and performance engineers in building our personalization and continual learning API, which powers models and agents that learn from user context.

This role is focused on designing, optimizing, and scaling training and inference workloads —bridging the gap between cutting-edge AI research and production. This includes:

  • Designing and executing new frameworks, techniques, and systems to improve performance, reliability, latency, and efficiency.

  • Partner closely with researchers, turning prototypes into systems that run at scale and feeding systems constraints back into research decisions.

  • Optimize serving paths for personalization and memory retrieval, where per-user state and low latency both matter.

  • Work on distributed training — data and model parallelism, communication scheduling, and scaling efficiency across multiple GPUs and nodes.

You'll be the bridge between researchers and platform engineering, while working in deep collaboration with our customers (AI-native application-layer companies like Notion and Harvey). The architecture will be shaped by the constraints and requirements of our R&D work. There are no walls between product, research, and engineering here; delivering on our mission requires a multidisciplinary approach.

This is a founding hire in the truest sense. You’ll set the bar for engineering at Engram: code review, testing, on-call, and a security posture that gives customers confidence in entrusting us with their most sensitive data. You’ll also help build the engineering team around you and influence our engineering culture as we scale.

Your background looks like

  • Bachelor’s degree or equivalent experience in computer science, engineering, or similar.

  • 5+ years of experience with training or inference systems, optimized workloads with measurable results.

  • Strong engineering foundation, with demonstrated excellence navigating complex technical environments and shipping high-quality code in a fast-paced environment.

  • Deep understanding of ML framework (eg. PyTorch, JAX), GPUs, distributed systems, and infrastructure.

  • Operate well in ambiguous environments — you will have real ownership and be responsible for steering the ship in a novel sector of the industry.

  • You have a bias toward action and a knack for turning research concepts into concrete, executable plans.

Bonus points if you have

  • Prior early-stage experience.

  • Experience in open-source ML or systems infrastructure projects.

Engram is based in San Francisco. This role is in-person in our SF office. We offer competitive cash compensation and startup equity.

Engram is an equal opportunity employer. We’re building a team that reflects a range of backgrounds and perspectives, and we welcome applicants regardless of race, color, religion, national origin, gender, gender identity, sexual orientation, age, disability, or veteran status.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

San Francisco, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.