Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
San Francisco, California, United States
Actively hiring, first seen by us 8 hours agoWork setup in the employer’s posting: On-siteFrom the employer’s posting
Employment type in the employer’s posting: FullTimeFrom the employer’s posting
An RL environment is only useful once it runs reliably inside a lab's training stack.
As an MTS on our ML Platform team, you will own the systems that take an environment from a builder's repo to a lab's training run.
Build and maintain Karotte, our open-source environment framework, from API design through releases and migrations that keep existing environments working.
Partner with environment builders and post-training researchers to turn recurring pain points into platform features, and ship quickly in response to their feedback.
An RL environment is only useful once it runs reliably inside a lab's training stack. Every environment we build has to be packaged, sandboxed, run at scale, checked against each lab's requirements, and delivered in the format that lab's platform expects. Much of that work is still manual today, and it takes time away from the people designing environments.
As an MTS on our ML Platform team, you will own the systems that take an environment from a builder's repo to a lab's training run. That includes Karotte, our open-source framework for defining RL environments, the internal platform that builds, runs, and reviews environments on CPU, GPU, and TPU, and the integrations that deliver them to each lab we work with. This is a senior ML platform engineering role where you will ensure what our Capabilities team builds runs and ships cleanly.
Own the integrations that deliver our environments to partner labs: build container images, match each lab's submission format, and automate the checks that confirm requirements are met before anything ships. Do the delivery work by hand where you have to, then automate it. Build and maintain Karotte, our open-source environment framework, from API design through releases and migrations that keep existing environments working. Run and scale the infrastructure that builds, runs, and grades environments, including containerized rollouts and grading across CPU, GPU, and TPU, VM-based sandboxing, and the resource limits and isolation that stop a model from gaming its own grader.
Build the internal tools environment builders use every day (CLI, docs, data catalog, access controls, and run monitoring) so they spend their time on environment design instead of infrastructure. Partner with environment builders and post-training researchers to turn recurring pain points into platform features, and ship quickly in response to their feedback. What We are Looking For
Visa sponsorship & relocation support availableRead the full posting
5+ years of experience building and owning ML Platform Engineering, ideally AI related ML Platform Engineering
Experience building RL environments, eval harnesses, or agent benchmarks (Terminal-Bench, SWE-bench, or similar).
Hands-on experience with containers and orchestration (Docker, Kubernetes, or similar) and at least one major cloud platform (GCP, AWS, or similar).
Familiarity with RL post-training and inference stacks (verl, Ray, SkyPilot, vLLM, SGLang, or similar).
Proficiency in Python, including writing libraries and APIs that other people build on.
From the employer’s posting.
We build RL environments for training capable, better-aligned superintelligences.
In the employer’s words · Read in context
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 7 and day 75.
From 5,846 similar postings that came down. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Extensive hands-on use of coding agents (Claude Code, Cursor, Codex, or similar), and an intuition for where models cut corners. - Proficiency in Python, including writing libraries and APIs that other people build on. Nice to Have
- Strong software engineering fundamentals and a track record of building and operating production infrastructure or developer platforms that other engineers depend on. - Hands-on experience with containers and orchestration (Docker, Kubernetes, or similar) and at least one major cloud platform (GCP, AWS, or similar). - A working understanding of how to run untrusted code safely: isolation, resource limits, and what happens when a process fills the disk or refuses to exit.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Preference Model is a superintelligence data research company. We build RL environments for training capable, better-aligned superintelligences.
Almost every aspect of how a model behaves is shaped by the reward signals it's trained on. The biggest problem with AIs today is that they don't always do what we intend. Sometimes that's because they aren't capable enough, and sometimes it's because they aren't aligned. Both problems come down to the training objectives.
We're trying to address both of these issues in the most direct, highest leverage way available to us, which today means researching how to build RL environments better, not just for the AIs of today but for the AIs as they will be when they outsmart us.
Over the past year, we've built RL environments for several frontier labs, and we're backed by $16M in seed funding led by a16z. Our founding team has previous experience on Anthropic’s data team building data infrastructure, and datasets behind Claude.
An RL environment is only useful once it runs reliably inside a lab's training stack. Every environment we build has to be packaged, sandboxed, run at scale, checked against each lab's requirements, and delivered in the format that lab's platform expects. Much of that work is still manual today, and it takes time away from the people designing environments.
As an MTS on our ML Platform team, you will own the systems that take an environment from a builder's repo to a lab's training run. That includes Karotte, our open-source framework for defining RL environments, the internal platform that builds, runs, and reviews environments on CPU, GPU, and TPU, and the integrations that deliver them to each lab we work with. This is a senior ML platform engineering role where you will ensure what our Capabilities team builds runs and ships cleanly.
You'll join a small Platform team and work directly with environment builders and post-training researchers. In your first six months, success looks like a delivery path to each partner lab that is mostly automated: tasks marked ready get built, validated against that lab's requirements, and packaged without hand work. Our needs change quickly, so you'll also pick up other platform and infrastructure work as priorities shift.
Own the integrations that deliver our environments to partner labs: build container images, match each lab's submission format, and automate the checks that confirm requirements are met before anything ships. Do the delivery work by hand where you have to, then automate it.
Build and maintain Karotte, our open-source environment framework, from API design through releases and migrations that keep existing environments working.
Run and scale the infrastructure that builds, runs, and grades environments, including containerized rollouts and grading across CPU, GPU, and TPU, VM-based sandboxing, and the resource limits and isolation that stop a model from gaming its own grader.
Build the internal tools environment builders use every day (CLI, docs, data catalog, access controls, and run monitoring) so they spend their time on environment design instead of infrastructure.
Partner with environment builders and post-training researchers to turn recurring pain points into platform features, and ship quickly in response to their feedback.
5+ years of experience building and owning ML Platform Engineering, ideally AI related ML Platform Engineering
Strong software engineering fundamentals and a track record of building and operating production infrastructure or developer platforms that other engineers depend on.
Hands-on experience with containers and orchestration (Docker, Kubernetes, or similar) and at least one major cloud platform (GCP, AWS, or similar).
A working understanding of how to run untrusted code safely: isolation, resource limits, and what happens when a process fills the disk or refuses to exit.
You've owned something tedious end to end, such as a migration, a release process, or a delivery pipeline, and automated away as much of it as you could.
Extensive hands-on use of coding agents (Claude Code, Cursor, Codex, or similar), and an intuition for where models cut corners.
Proficiency in Python, including writing libraries and APIs that other people build on.
Experience building RL environments, eval harnesses, or agent benchmarks (Terminal-Bench, SWE-bench, or similar).
Familiarity with RL post-training and inference stacks (verl, Ray, SkyPilot, vLLM, SGLang, or similar).
You've built sandbox or code-execution infrastructure (microVMs such as Firecracker, gVisor, or similar) at an infrastructure startup or frontier lab.
You've been an early platform or infrastructure engineer at a startup and built the internal platform the rest of engineering relied on.
You've worked as a forward deployed or integrations engineer, getting your company's software running inside customers' own environments.
You've built developer tooling or internal platforms used by ML researchers, even outside a formal ML role.
You've maintained an open-source developer framework with real external users.
Competitive cash and equity compensation (>90th percentile)
Ownership and autonomy in a fast moving startup environment
Opportunity to work alongside senior and staff engineers from frontier labs and infrastructure companies, plus top ML engineers
Health, vision, dental, benefits
401K match
Lunch provided everyday onsite
Weekly snack orders
Visa sponsorship & relocation support available
We value diverse perspectives and experiences. If you're excited about this role but don't check every box, we still encourage you to apply.
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco, California, United States
Working pattern and location restrictions need checking in the full posting.
- Weekly snack orders - Visa sponsorship & relocation support available We value diverse perspectives and experiences. If you're excited about this role but don't check every box, we still encourage you to apply.