Back to jobs

Applied Machine Learning Engineer

San Francisco · San Francisco, California, United States

Open 5 months, first seen by us 172 days ago
Pay
$220,000–320,000/year · BaseAnnual period assumed. Plus equity — pay source
Compensation We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $220,000 - $320,000, plus equity and benefits, depending on experience. Equal Opportunity
Read the full posting
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering — team source
Department: Engineering
From the employer’s posting

What you’ll work on

Full posting

You will be responsible for building and improving the core ML systems that power our custom model training platform, while also applying these systems directly for customers.

Your north star is model quality at scale, measured by how well our custom models match frontier performance, how efficiently we can train and serve them, and how smoothly we can deliver results to our customers.

  • Build and maintain data processing pipelines for training data

  • Train models with internal frameworks and iterate on evaluation results

  • Develop benchmarks and evaluations so custom models match frontier performance

  • Take research techniques and ship them into production

From the employer’s posting
You will be responsible for building and improving the core ML systems that power our custom model training platform, while also applying these systems directly for customers. Your role sits at the intersection of applied research and production engineering. You'll lead projects from data intake to trained model, building the infrastructure and tooling along the way.
Your north star is model quality at scale, measured by how well our custom models match frontier performance, how efficiently we can train and serve them, and how smoothly we can deliver results to our customers. You'll own the full training lifecycle: processing data, creating dashboards for visibility, training models using our frameworks, running evaluations, and shipping results. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to push the boundaries of what's possible in custom model training.
Build and maintain data processing pipelines for aggregating, transforming, and validating training data
Train models using our internal frameworks and iterate based on evaluation results
Develop robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance
Take research features and ship them into production settings

Before you apply

Employer’s visa record
2 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • 2+ years training AI models using PyTorch
  • Hands-on experience post-training LLMs with SFT or RL
  • Strong understanding of transformer architectures and training
  • Experience with LLM training frameworks such as Hugging Face Transformers or DeepSpeed
  • Experience training on NVIDIA GPUs
Qualification wording
2+ years of experience training AI models using PyTorch
Hands-on experience with post-training LLMs using SFT or RL
Strong understanding of transformer architectures and how they're trained
Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Axolotl, or similar)
Experience training on NVIDIA GPUs

About Inference

Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost.

In the employer’s words · Read in context · Company website ↗

Apply at Inference

Posting record

Report an error

Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 2, 2026172 days ago
Recorded sightings
87
Last seen by us
Nov 22, 2026
Employer says posted
Jan 5, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$220K–$320K against $166K–$237K, the middle half of what similar US postings state.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 172

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Inference is hiring

2 open jobs

  • No new data jobs since June
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Hugging Face
  • PyTorch
  • Transformers
Where the posting names them
- Strong understanding of transformer architectures and how they're trained - Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Axolotl, or similar) - Experience training on NVIDIA GPUs
Requirements - 2+ years of experience training AI models using PyTorch - Hands-on experience with post-training LLMs using SFT or RL

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Help us build the systems that train specialized AI models for the fastest-growing companies in the world. If you love taking cutting-edge ML techniques and turning them into products that ship, we'd love to meet you.

About Inference.net

Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are smaller, faster, and up to 90% cheaper. Our platform handles everything end-to-end: distillation, training, evaluation, and planet-scale hosting.

We are a well-funded ten-person team of engineers who work in-person in downtown San Francisco on difficult, high-impact engineering problems. Everyone on the team has been writing code for over 10 years, and has founded and run their own software companies. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do. Most of us are in the office 4 days a week in SF; hybrid works for Bay Area candidates.

About the Role

You will be responsible for building and improving the core ML systems that power our custom model training platform, while also applying these systems directly for customers. Your role sits at the intersection of applied research and production engineering. You'll lead projects from data intake to trained model, building the infrastructure and tooling along the way.

Your north star is model quality at scale, measured by how well our custom models match frontier performance, how efficiently we can train and serve them, and how smoothly we can deliver results to our customers. You'll own the full training lifecycle: processing data, creating dashboards for visibility, training models using our frameworks, running evaluations, and shipping results. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to push the boundaries of what's possible in custom model training.

Key Responsibilities

  • Lead projects from from data intake through the full training pipeline, including processing, cleaning, and preparing datasets for model training

  • Build and maintain data processing pipelines for aggregating, transforming, and validating training data

  • Create dashboards and visualization tools to display training metrics, data quality, and model performance

  • Train models using our internal frameworks and iterate based on evaluation results

  • Develop robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance

  • Build systems to automate portions of the training workflow, reducing manual intervention and improving consistency

  • Take research features and ship them into production settings

  • Apply the latest techniques in SFT, RL, and model optimization to improve training quality and efficiency

  • Collaborate with infrastructure engineers to scale training across our GPU fleet

  • Deeply understand customer use cases to inform training strategies and surface edge cases

Requirements

  • 2+ years of experience training AI models using PyTorch

  • Hands-on experience with post-training LLMs using SFT or RL

  • Strong understanding of transformer architectures and how they're trained

  • Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Axolotl, or similar)

  • Experience training on NVIDIA GPUs

  • Strong data processing skills and comfortable building ETL pipelines and working with large datasets

  • Track record of creating benchmarks and evaluations

  • Ability to take research techniques and apply them to production systems

Nice-to-Have

  • Experience with model distillation or knowledge transfer

  • Experience building dashboards and data visualization tools

  • Familiarity with vision encoders and multimodal models

  • Experience with distributed training at scale

  • Contributions to open-source ML projects

You don't need to tick every box. Curiosity and the ability to learn quickly matter more.

Compensation

We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $220,000 - $320,000, plus equity and benefits, depending on experience.

Equal Opportunity

Inference.net is an equal opportunity employer. We welcome applicants from all backgrounds and don't discriminate based on race, color, religion, gender, sexual orientation, national origin, genetics, disability, age, or veteran status.

If you're excited about building the future of custom AI infrastructure, we'd love to hear from you. Please send your resume and GitHub to amar@inference.net and/or apply here on Ashby.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $220,000 - $320,000, plus equity and benefits, depending on experience. Equal Opportunity
Location & working pattern

San Francisco, California, United States

Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are smaller, faster, and up to 90% cheaper. Our platform handles everything end-to-end: distillation, training, evaluation, and planet-scale hosting. We are a well-funded ten-person team of engineers who work in-person in downtown San Francisco on difficult, high-impact engineering problems. Everyone on the team has been writing code for over 10 years, and has founded and run their own software companies. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do. Most of us are in the office 4 days a week in SF; hybrid works for Bay Area candidates. About the Role
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.