Back to jobs

ML Systems - Member of Technical Staff

San Francisco · San Francisco, California, United States

Open 3 months, first seen by us 101 days ago
Pay
USD 200,000–400,000/yearAnnual period assumed — pay source
At Simile, we provide competitive compensation packages that include base salary, equity, and comprehensive benefits. Salary Range: $200,000 – $400,000 USD Note: Final offers are based on experience, specialized skills, interview performance, and relevant training.
Read the full posting
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Research — team source
Department: Research
From the employer’s posting

What you’ll work on

Full posting

As a Member of Technical Staff in ML Systems, you will build the platform our researchers train, evaluate, and deploy on - and own it through the last mile, where a trained checkpoint becomes a production service serving millions of interdependent agent calls at a cost per simulation we can afford.

This is a role for someone who is energized by both halves of that.

  • Build and operate the ML platform covering data, training, evaluation, and deployment

  • Speed up training and data pipelines, including model FLOPs utilization and ingestion

  • Optimize the inference path: batching, scheduling, KV cache reuse, and quantization

  • Lead redesign of data architecture and schemas for simulation models

  • Keep the multi-node GPU cluster healthy and saturated across compute providers

From the employer’s posting
As a Member of Technical Staff in ML Systems, you will build the platform our researchers train, evaluate, and deploy on - and own it through the last mile, where a trained checkpoint becomes a production service serving millions of interdependent agent calls at a cost per simulation we can afford.
This is a role for someone who is energized by both halves of that. You will spend some weeks designing the data schemas and training pipelines a research team depends on, others profiling a serving path to find where the FLOPs and GPU memory are going, and others still bringing up cluster nodes or deleting the third redundant copy of a code path. The common thread is leverage: every improvement you make compounds across every researcher and every simulation we run.
Build the ML platform our researchers live in.
Make training and data pipelines fast.
Own the inference path our simulations run on: batching and scheduling, KV cache reuse across agents sharing context, quantization
Lead the redesign of our data architecture to handle the complexity and sheer volume of our simulation models.
Keep a multi-node fleet healthy and saturated

What you’ll bring

All qualifications

Core experience

  • Experience optimizing inference for multi-agent or agentic environments, where requests are interdependent rather than independent.
  • Experience with distributed training at scale.
  • Experience building and shipping production AI agents, and familiarity with LLM serving frameworks (vLLM, SGLang, TensorRT-LLM) and inference-time optimization.
Qualification wording
Experience optimizing inference for multi-agent or agentic environments, where requests are interdependent rather than independent.
Experience with distributed training at scale.
Experience building and shipping production AI agents, and familiarity with LLM serving frameworks (vLLM, SGLang, TensorRT-LLM) and inference-time optimization.

About Simile

Pilots don't train with real passengers.

In the employer’s words · Read in context · Company website ↗

Apply at Simile

Posting record

Report an error

Open 3 monthsWe first saw this posting 101 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 12, 2026101 days ago
Recorded sightings
81
Last seen by us
Nov 21, 2026
Employer says posted
Jul 30, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$200K–$400K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 101

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,389 similar postings that came down. Coming down is not always a hire.

Simile is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • PyTorch
Where the posting names them
You might thrive in this role if you - Have deep systems and ML proficiency. High proficiency in Python and hands-on experience with modern ML frameworks (e.g., PyTorch, JAX). You can refactor a complex codebase for both performance and architectural integrity. - Understand modern ML architectures well enough to optimize them. You have an intuition for where the time and memory go and can act on it. You are comfortable around NVIDIA GPUs and the surrounding stack (NCCL, InfiniBand and NVLink topology, CUDA, Triton) or can get there quickly. Writing custom kernels is a bonus here, not the job.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About the Company

Pilots don't train with real passengers. Actors don't rehearse with real audiences. Yet, the most consequential decisions in society are often pushed straight to production.

Simile is changing that. We have built the first AI simulation of society, populated by generative agents based on real humans. Our research pioneered the field of AI-based simulation, proving it is possible to model human behavior with high accuracy. Today, we are developing a Foundation Model to predict human behavior in any situation, at any scale.

We have raised $300M in total funding, with a $2B post-money valuation in our latest round. Our investors include Greenoaks, Index Ventures, Hanabi, A*, Bain Capital Ventures, Factory, CVS Health Ventures, and Definition.


About the Team

Simile's Research organization builds the systems that every step of the model lifecycle runs on: data ingestion and schema design, distributed training, evaluation, serving, and monitoring. We are the reason a researcher's hypothesis can become a production simulation in days rather than quarters.

Two things make this problem unusual. First, our research-to-product pipeline is unusually tight - the experimental methods we validate on Monday are integrated into systems customers use to make high-stakes decisions. Second, simulating a society means running inference over populations of agents, not single requests. A single customer study can mean millions of model calls with interdependent state. Cost per simulation and latency per agent are not back-office metrics for us; they determine what research is even possible to run.

About the Role

As a Member of Technical Staff in ML Systems, you will build the platform our researchers train, evaluate, and deploy on - and own it through the last mile, where a trained checkpoint becomes a production service serving millions of interdependent agent calls at a cost per simulation we can afford.

This is a role for someone who is energized by both halves of that. You will spend some weeks designing the data schemas and training pipelines a research team depends on, others profiling a serving path to find where the FLOPs and GPU memory are going, and others still bringing up cluster nodes or deleting the third redundant copy of a code path. The common thread is leverage: every improvement you make compounds across every researcher and every simulation we run.

We are looking for engineers who find it gratifying to see their work pushed to its absolute limits, and who own problems end-to-end - including the last mile of deployment that most people would rather hand off.

In this role, you will

  • Build the ML platform our researchers live in. Design and operate the services, libraries, and tooling that cover the full lifecycle - data exploration, feature generation, experiment tracking, training orchestration, evaluation, and deployment. Success is defined by your ability to increase experiment velocity, streamlining the researcher’s path from ideation to a fully validated, production-ready model.

  • Make training and data pipelines fast. Own throughput end to end: model FLOPs utilization across our training configs, tokenization cost when the data mix changes, and ingestion paths that take hours today where they should take minutes. Profile where the time and GPU memory actually go, then fix it, including the observability that makes the next bottleneck obvious before it bites.

  • Make serving fast and cheap enough to run a society. Own the inference path our simulations run on: batching and scheduling, KV cache reuse across agents sharing context, quantization, and the request patterns unique to population-scale runs where one study is millions of interdependent calls. Cost per simulation and latency per agent decide what research we can afford to run at all, so treat them as research constraints, not ops metrics.

  • Scaling simulation Data. Lead the redesign of our data architecture to handle the complexity and sheer volume of our simulation models. You will define the schemas and ingestion logic to unify high-variety input streams (e.g., human survey behavior) and scale our training pipelines to meet the intense demands of society-scale modeling.

  • Own the GPU cluster. Keep a multi-node fleet healthy and saturated: node bring-up, topology-aware NCCL and RDMA configuration, scheduling and queue depth, storage lifecycle and checkpoint capacity, autoscaling of serving capacity alongside training jobs, and the alerting that tells us when GPUs are sitting idle. We run across more than one compute provider, so keeping the whole stack portable is part of the job.

  • Engineer scientific evaluations. Build evaluation tooling that goes beyond standard benchmarks, with rigorous statistical frameworks that prove the fidelity of our simulations - and that run fast enough to be part of the development loop rather than a gate at the end of it.

  • Push the state of the art. Reproduce, critique, and improve upon academic work in simulation, training, and inference optimization. Translate theoretical breakthroughs into production improvements, and document them with academic-level rigor.

Requirements

You might thrive in this role if you

  • Have deep systems and ML proficiency. High proficiency in Python and hands-on experience with modern ML frameworks (e.g., PyTorch, JAX). You can refactor a complex codebase for both performance and architectural integrity.

  • Understand modern ML architectures well enough to optimize them. You have an intuition for where the time and memory go and can act on it. You are comfortable around NVIDIA GPUs and the surrounding stack (NCCL, InfiniBand and NVLink topology, CUDA, Triton) or can get there quickly. Writing custom kernels is a bonus here, not the job.

  • Have built production ML platforms or MLOps systems. You have shipped the infrastructure other engineers and researchers build on: training orchestration, experiment tooling, model serving, or LLM application platforms. You know what makes the difference between a platform people adopt and one they work around.

  • Have architected, observed, and debugged production distributed systems. Bonus if they were performance-critical, and bonus again if you have had to substantially rebuild or refactor them as scale increased.

  • Own the deployment pipeline. You understand the training and fine-tuning lifecycle and can architect what continuous ingestion, monitoring, and high-availability serving actually require in practice.

  • Are research- and data-literate. You can navigate the ML research frontier, reproduce complex papers, tackle genuinely messy data states, and write about what you found with rigor.

  • Are self-directed and pragmatic. You figure out the most important problem to work on, pick up whatever knowledge you are missing to finish it, and know when to build the ideal solution versus when to adjust course.

  • Have a humble attitude, an eagerness to help your colleagues, and a desire to do whatever it takes for the team to succeed.

  • Have a strong quantitative foundation - typically a degree in Computer Science, Mathematics, Statistics, or a related field, though we care about demonstrated ability far more than credentials.

Nice to haves

  • Experience optimizing inference for multi-agent or agentic environments, where requests are interdependent rather than independent.

  • Experience with distributed training at scale.

  • Experience building and shipping production AI agents, and familiarity with LLM serving frameworks (vLLM, SGLang, TensorRT-LLM) and inference-time optimization.

  • Interdisciplinary background in social science modeling or behavioral economics.

Compensation & Benefits

At Simile, we provide competitive compensation packages that include base salary, equity, and comprehensive benefits.

  • Salary Range: $200,000 – $400,000 USD

    • Note: Final offers are based on experience, specialized skills, interview performance, and relevant training.

  • Equity: Grants are available for eligible roles, subject to board approval.

  • Health & Wellness: Comprehensive medical, dental, and vision coverage.

  • Time Off: Flexible time off policies to support work-life balance.

Our Process

We prioritize thoughtful conversations and clear examples of past work. Our hiring journey is designed to help both sides align on fit, working style, and expectations.

Reapplication Policy: To ensure a fair and thorough evaluation for all applicants, Simile observes a 90-day waiting period before reconsidering candidates for the same role.

Commitment to Diversity & Inclusion

Equal Opportunity: Simile is an equal opportunity workplace. We welcome applicants of all backgrounds and identities, valuing an environment where everyone can contribute authentically.

Accommodations: If you require support or reasonable accommodations during the application process due to a disability, please let us know. We are happy to assist.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
At Simile, we provide competitive compensation packages that include base salary, equity, and comprehensive benefits. Salary Range: $200,000 – $400,000 USD Note: Final offers are based on experience, specialized skills, interview performance, and relevant training.
Location & working pattern

San Francisco, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.