Pay
Higher than most similar jobs
$250K–$350K against $166K–$237K, the middle half of what similar US postings state.
From 1,537 postings in the last year. Stated ranges, not salaries paid.
San Francisco · San Francisco, California, United States
Open 5 months, first seen by us 172 days agoCompensation We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $250,000 - $350,000, plus equity and benefits, depending on experience. Equal OpportunityRead the full posting
Location type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
You will be responsible for conducting research into experimental models, training systems, and modalities to create novel products for our customers.
Your north star is pushing the frontier of what's possible in LLM post-training.
Research new model architectures to improve quality, efficiency, or capability
Run experiments with SFT, RLHF, DPO and other post-training methods
Develop and improve the distillation pipeline for training from frontier teachers
Train models for clients and run evaluations to validate findings
Explore ways to decrease inference latency and improve serving efficiency
You will be responsible for conducting research into experimental models, training systems, and modalities to create novel products for our customers. Your work will span from exploring new architectures and learning methods to optimizing latency and efficiency, with the goal of delivering better models to customers.
Your north star is pushing the frontier of what's possible in LLM post-training. You'll explore new techniques, run rigorous experiments, and when something works, help bring it into production with the help of your teammates. This includes training models for customers and running evaluations as part of validating your research. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to explore ambitious ideas and ship the ones that work.
Research and experiment with new model architectures to improve quality, efficiency, or capability
Run experiments with new learning methods, including novel approaches to SFT, RLHF, DPO, and other post-training techniques
Develop and improve our distillation pipeline for training high-quality models from frontier teachers
Train models for clients and run evaluations to validate research findings in production settings
Explore methods to decrease inference latency and improve serving efficiency
3+ years of experience training AI models using PyTorch
Experience training on NVIDIA GPUs at scale
Experience with model distillation or knowledge transfer
Deep understanding of transformer architectures, attention mechanisms, and model internals
Experience with LLM speed optimization techniques
Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or other alignment techniques
Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost.
In the employer’s words · Read in context · Company website ↗
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Higher than most similar jobs
$250K–$350K against $166K–$237K, the middle half of what similar US postings state.
From 1,537 postings in the last year. Stated ranges, not salaries paid.
Day 172
Up longer than most. Similar jobs usually come down between day 7 and day 76.
From 6,398 similar postings that came down. Coming down is not always a hire.
2 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or other alignment techniques - Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Megatron, TRL, or similar) - Strong experimental methodology, including ability to design, run, and analyze rigorous experiments
Requirements - 3+ years of experience training AI models using PyTorch - Deep understanding of transformer architectures, attention mechanisms, and model internals
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
Help us push the boundaries of what's possible in LLM post-training. If you love training models, exploring new architectures, running experiments, and turning research insights into products that ship, we'd love to meet you.
About Inference.net
Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are smaller, faster, and up to 90% cheaper. Our platform handles everything end-to-end: distillation, training, evaluation, and planet-scale hosting.
We are a well-funded ten-person team of engineers who work in-person in downtown San Francisco on difficult, high-impact engineering problems. Everyone on the team has been writing code for over 10 years, and has founded and run their own software companies. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do. Most of us are in the office 4 days a week in SF; hybrid works for Bay Area candidates.
About the Role
You will be responsible for conducting research into experimental models, training systems, and modalities to create novel products for our customers. Your work will span from exploring new architectures and learning methods to optimizing latency and efficiency, with the goal of delivering better models to customers.
Your north star is pushing the frontier of what's possible in LLM post-training. You'll explore new techniques, run rigorous experiments, and when something works, help bring it into production with the help of your teammates. This includes training models for customers and running evaluations as part of validating your research. This role reports directly to the founding team. You'll have the autonomy, a large compute budget / GPU reservation, and technical support to explore ambitious ideas and ship the ones that work.
Key Responsibilities
Research and experiment with new model architectures to improve quality, efficiency, or capability
Explore methods to decrease inference latency and improve serving efficiency
Run experiments with new learning methods, including novel approaches to SFT, RLHF, DPO, and other post-training techniques
Perform reinforcement learning research to improve model alignment and capability
Develop and improve our distillation pipeline for training high-quality models from frontier teachers
Train models for clients and run evaluations to validate research findings in production settings
Create robust benchmarks and evaluation frameworks that ensure custom models match or exceed frontier performance
Stay current with ML research and identify techniques that can improve our platform
Collaborate with applied engineers to bring successful research into production systems
Document findings and share knowledge with the team
Requirements
3+ years of experience training AI models using PyTorch
Deep understanding of transformer architectures, attention mechanisms, and model internals
Hands-on experience with post-training LLMs using SFT, RLHF, DPO, or other alignment techniques
Experience with LLM-specific training frameworks (e.g., Hugging Face Transformers, DeepSpeed, Megatron, TRL, or similar)
Strong experimental methodology, including ability to design, run, and analyze rigorous experiments
Track record of implementing ideas from recent ML papers
Experience training on NVIDIA GPUs at scale
Strong foundation in ML fundamentals: optimization, loss functions, regularization, generalization
Nice-to-Have
Publications in ML venues
Experience with model distillation or knowledge transfer
Experience with LLM speed optimization techniques
Familiarity with vision encoders, multimodal models, or other modalities
Experience with distributed training and infrastructure at scale
Contributions to open-source ML projects
You don't need to tick every box. Curiosity and the ability to learn quickly matter more.
Compensation
We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $250,000 - $350,000, plus equity and benefits, depending on experience.
Equal Opportunity
Inference.net is an equal opportunity employer. We welcome applicants from all backgrounds and don't discriminate based on race, color, religion, gender, sexual orientation, national origin, genetics, disability, age, or veteran status.
If you're excited about pushing the boundaries of custom AI research, we'd love to hear from you. Please send your resume and GitHub to amar@inference.net and/or here on Ashby.
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation We offer competitive compensation, equity in a high-growth startup, and comprehensive benefits. The base salary range for this role is $250,000 - $350,000, plus equity and benefits, depending on experience. Equal Opportunity
San Francisco, California, United States
Inference.net trains and hosts specialized language models for companies who want frontier-quality AI at a fraction of the cost. The models we train match GPT-5 accuracy but are smaller, faster, and up to 90% cheaper. Our platform handles everything end-to-end: distillation, training, evaluation, and planet-scale hosting. We are a well-funded ten-person team of engineers who work in-person in downtown San Francisco on difficult, high-impact engineering problems. Everyone on the team has been writing code for over 10 years, and has founded and run their own software companies. We are high-agency, adaptable, and collaborative. We value creativity alongside technical prowess and humility. We work hard, and deeply enjoy the work that we do. Most of us are in the office 4 days a week in SF; hybrid works for Bay Area candidates. About the Role
No clear work-authorization passage found. Eligibility is unconfirmed.