Back to jobs

Machine Learning Systems Engineer

Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
On-site — work setting source
Work setup in the employer’s posting: IN_OFFICE
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Design and maintain ML pipelines for training, evaluation, and inference of LLMs

  • Design and tune custom CUDA kernels for transformer operations on GPUs

  • Apply low-precision quantization to cut memory use and speed up inference

  • Build and maintain inference engines for on-premises deployments

  • Architect distributed training and inference systems

From the employer’s posting
Design and maintain high-performance ML pipelines for training, evaluation, and inference of LLMs
Optimize core transformer operations at the kernel level, designing and tuning custom kernels and low-level implementations for GPU-accelerated workloads
Implement and integrate low-precision computation techniques to reduce memory footprint and accelerate inference with minimal accuracy degradation
Build and maintain inference engines for on premises deployments
Architect distributed training and inference systems

Before you apply

Work authorization
Sponsors visas

Benefits in the posting

Full benefits wording
  • Unlimited PTO: Recharge when you need it, no questions asked.
  • Comprehensive Health Coverage: Medical, dental, and vision insurance for you and your dependents.
  • Visa Sponsorship: We welcome global talent and provide visa sponsorship to support qualified candidates.

From the employer’s posting.

About Voltai-Com

Voltai is the leading AI company building agentic systems and frontier foundation models for semiconductor and electronics design.

In the employer’s words · Read in context

Apply at Voltai-Com

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Voltai-Com is hiring

7 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C
  • C++
  • Rust
Where the posting names them
Required Skill Sets - Languages: Expertise in C, C++, or Rust - Design and Optimize CUDA Kernels for LLMs: Develop and fine-tune custom CUDA kernels to accelerate core transformer operations

Your next step

Complete your application on jobs.gem.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

About Voltai
Voltai is the leading AI company building agentic systems and frontier foundation models for semiconductor and electronics design. Backed by Sequoia Capital, we’re putting AI in the hands of hardware engineers in over 70% of the world’s largest semiconductor and electronics companies to have effortless control over their next-generation chip and board designs, powering the future of automotive, industrial automation, consumer electronics, IoT, and semiconductor manufacturing. 

About the Team
Our founding team consists of IOI/IPhO olympiad medalists, Stanford professors, ex-CTO of Synopsys, and our business leadership has scaled revenue in their previous companies to over $1.5bn. At Voltai, we are combining the world’s best talent in the intersection of software and hardware.


Key Responsibilities
  • Design and maintain high-performance ML pipelines for training, evaluation, and inference of LLMs and retrieval-augmented systems, with a focus on hardware efficiency and throughput
  • Optimize core transformer operations at the kernel level, designing and tuning custom kernels and low-level implementations for GPU-accelerated workloads
  • Implement and integrate low-precision computation techniques to reduce memory footprint and accelerate inference with minimal accuracy degradation
  • Build and maintain inference engines for on premises deployments
  • Architect distributed training and inference systems
  • Collaborate closely with researchers and infra teams to bring cutting-edge model innovations into production
  • Interface directly with enterprise hardware environments, tuning performance based on real-world deployment constraints

Required Skill Sets
  • Languages: Expertise in C, C++, or Rust
  • Design and Optimize CUDA Kernels for LLMs: Develop and fine-tune custom CUDA kernels to accelerate core transformer operations
  • Implement Low-Precision Computation Techniques: Apply quantization methods like AWQ and GPTQ to reduce model size and inference latency. Ensure minimal accuracy loss while maximizing throughput on GPU architectures with familiarity with concepts like GGUF and GGML
  • Develop and Maintain High-Performance Inference Systems: Build, improve, and maintain inference engines such as vLLM, SGLang, and TensorRT with a focus on low-latency and high throughput​
  • Architect Distributed Training and Inference Solutions: Design systems that support model parallelism (tensor, pipeline, expert etc) to enable efficient training and inference across multiple GPUs and nodes
  • Integrate Research into Production Systems: Translate cutting-edge research findings into robust, production-ready systems. Ensure that innovations in model architectures and optimization techniques are effectively deployed.
  • Monitor and Optimize System Performance: Implement monitoring tools to track system metrics, identify bottlenecks, and optimize performance

Bonus Points
  • Some background in hardware/electronics, gained through professional, academic, or personal projects
  • Contributions to open-source initiatives
  • Notable awards or publications in leading journals/conferences
  • Experience thriving in a fast-paced, hyper-growth startup environment

Our Benefits
  • Unlimited PTO: Recharge when you need it, no questions asked.
  • Comprehensive Health Coverage: Medical, dental, and vision insurance for you and your dependents. 
  • Free Meals and Snacks: Daily lunches, dinners, and snacks in the office.
  • Professional Growth: We invest in your continuous learning and offer opportunities to expand your skills.
  • Visa Sponsorship: We welcome global talent and provide visa sponsorship to support qualified candidates.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Menlo Park, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization
- Professional Growth: We invest in your continuous learning and offer opportunities to expand your skills. - Visa Sponsorship: We welcome global talent and provide visa sponsorship to support qualified candidates.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.