Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Sunnyvale, CA
Actively hiring, first seen by us 8 hours agoWork setup in the employer’s posting: IN_OFFICEFrom the employer’s posting
Employment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
We are hiring a Founding ML Infrastructure Engineer to own the end-to-end deployment, optimization, and operation of our suits of models in production.
This is a core founding role focused on building and operating production-grade LLM systems.
Own the end-to-end LLM inference stack, including:- Model loading and execution
Design and operate high-performance LLM serving systems using technologies such as:- vLLM, TensorRT / TensorRT-LLM, Triton Inference Server, SGLang
Work hands-on with PyTorch and TensorFlow models, including:- Model graph understanding
We are hiring a Founding ML Infrastructure Engineer to own the end-to-end deployment, optimization, and operation of our suits of models in production.
This is a core founding role focused on building and operating production-grade LLM systems. You will apply deep knowledge of model internals to deploy, optimize, and run modern LLMs at scale, owning performance end-to-end across latency, throughput, and reliability.
Key Responsibilities Own the end-to-end LLM inference stack, including:- Model loading and execution GPU utilization and memory efficiency
Production deployment and scaling Design and operate high-performance LLM serving systems using technologies such as:- vLLM, TensorRT / TensorRT-LLM, Triton Inference Server, SGLang Optimize inference across:- Latency
Cost efficiency Work hands-on with PyTorch and TensorFlow models, including:- Model graph understanding Attention mechanisms, KV cache behavior, batching strategies
Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and candidate. But if we make you an offer, we will make all reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.Read the full posting
Experience deploying LLMs on Kubernetes and GPU clusters.
Knowledge of observability for ML systems (metrics, latency breakdowns, GPU monitoring).
Familiarity with CUDA, NCCL, or low-level GPU performance concepts.
Experience working at startups or owning systems with minimal abstraction layers.
From the employer’s posting.
We help enterprises detect, debug, and prevent AI’s misbehaviors in production.
In the employer’s words · Read in context
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,507 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 7 and day 75.
From 5,846 similar postings that came down. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Preferred Qualifications - Experience deploying LLMs on Kubernetes and GPU clusters. - Familiarity with CUDA, NCCL, or low-level GPU performance concepts.
- Cost efficiency - Work hands-on with PyTorch and TensorFlow models, including:- Model graph understanding - Attention mechanisms, KV cache behavior, batching strategies
- Strong software engineering fundamentals; ability to write robust, maintainable production code. - Deep hands-on experience with LLM inference infrastructure, including:- PyTorch (required) - TensorFlow (working knowledge)
- Deep hands-on experience with LLM inference infrastructure, including:- PyTorch (required) - TensorFlow (working knowledge) - Proven experience with GPU inference optimization, including:- TensorRT / TensorRT-LLM
Complete your application on jobs.gem.com. The employer’s form will show what is required.
Already applied? Track this application
New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Sunnyvale, CA
Working pattern and location restrictions need checking in the full posting.
- Medical, Dental, Vision, Life insurance, 401-K, In-office lunch etc. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and candidate. But if we make you an offer, we will make all reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.