Back to jobs

Member of Technical Staff, ML Inference Engineering

Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: SALARIED_FT
From the employer’s posting

What you’ll work on

Full posting

Sanas is bringing real-time speech and language models on-premise — deployed at scale directly inside sovereign data centers, not served from behind a hosted cloud endpoint.

We're looking for a deeply hands-on, experienced engineer to help lead that build.

  • Write custom GPU kernels and low-level optimizations for inference

  • Apply graph optimization and operator fusion at the ML compiler level

  • Profile and resolve system bottlenecks for latency, throughput, and memory

  • Own and scale model serving across multi-GPU, multi-node deployments

  • Write custom inference server backends with business logic and state management

From the employer’s posting
Sanas is bringing real-time speech and language models on-premise — deployed at scale directly inside sovereign data centers, not served from behind a hosted cloud endpoint. It's one of the most demanding environments in the industry: strict latency budgets, massive concurrency, and infrastructure that needs to be private and reliable.
We're looking for a deeply hands-on, experienced engineer to help lead that build. This is someone who shapes core infrastructure and architecture decisions rather than just executing against a specification, and who naturally raises the level of the engineers working alongside them.
Implement custom kernels and low-level optimizations to push the absolute limits of GPU compute.
Apply graph optimization, operator fusion, and hardware-specific code generation at the ML compiler level.
Profile, analyze, and resolve deep system bottlenecks to radically improve latency, throughput, and memory efficiency.
Own and scale our overarching model serving infrastructure across multi-GPU, multi-node deployments to meet strict on-premise latency budgets.
Write and optimize custom inference server backends to handle complex business logic, scripting, and state management.

Tools in this posting

  • C
  • C++
  • Python
  • Rust
  • Kubernetes
Source — Tool mentions in context
● 8+ years of experience writing high-quality, high-performance code, including at least 5 years focused on machine learning systems. ● Experience with one of C/C++/Rust and Python. ● Deep familiarity with modern NVIDIA GPU architectures (e.g., Ada Lovelace, Blackwell), CUDA, and low-level system profiling.
● Hands-on experience with ML compilers and optimization frameworks (e.g., Apache TVM, TorchInductor/Dynamo, TensorRT, Triton). ● Experience building or extending model serving infrastructure, specifically writing custom C++ backends for Triton Inference Server (or similar serving engines). ● Fluency in the AI serving stack, from kernels and quantization up to schedulers, state management, and autoscaling.
● A research-leaning or systems background in Speech (STT, TTS, S2S) or LLM inference, with work you can point to. ● Experience operating large-scale, on-premise AI training or inference clusters, including bare-metal provisioning and Kubernetes management. ● Familiarity with high-performance networking (InfiniBand or RoCE), distributed storage systems, and hardware health monitoring.

Posting record

Report an error

Open 3 monthsWe first saw this posting 90 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 18, 202690 days ago
Recorded sightings
59
Last seen by us
Nov 17, 2026
Employer says posted
Aug 11, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,505 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 90

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 5,830 similar postings that came down. Coming down is not always a hire.

Sanas is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

Your next step

Check the employer’s posting for the current role and application details.

Applying through Rippling

  • “The résumé will be parsed to fill in the application details”: check what it filled before you send.

Already applied? Track this application

Job description

View original posting ↗

Sanas is pioneering the future of human communication. Founded by a team of Stanford researchers and entrepreneurs with deep industry experience, Sanas has developed the world's first real-time speech AI platform capable of accent translation, noise cancellation, speech enhancement, cross-language communication, and more.

Sanas makes conversations clearer, more inclusive, and more effective, removing barriers that prevent people from being understood, regardless of accent, background noise, or native language.

Sanas is currently one of the fastest growing startups in Silicon Valley, growing from $16M to $50M ARR in 2025. The company's core business is profitable and is on track to end 2026 with >$120M ARR. Our team combines deep expertise in model innovation and systems engineering with a design-minded product engineering culture to build and ship cutting-edge AI models and experiences — entirely in-house.

Sanas is a 130 person team, established in 2020. In this short span, we've successfully secured over $100 million in funding. Our innovation has been supported by the industry's leading investors, including Insight Partners, Google Ventures, Quadrille Capital, General Catalyst, Quiet Capital, and other influential investors. Our reputation is further solidified by collaborations with numerous Fortune 100 companies. With Sanas, you're not just adopting a product; you're investing in the future of communication.

If you’re looking to have a significant role in roadmapping and driving technical directions, if you’re looking to deploy challenging and big ideas without much overhead or slowness, if you're looking to leave your mark on an ambitious, generational mission to change how the worlds thinks about speech + AI, then Sanas is a well-suited place for you.

About the Role

Sanas is bringing real-time speech and language models on-premise — deployed at scale directly inside sovereign data centers, not served from behind a hosted cloud endpoint. It's one of the most demanding environments in the industry: strict latency budgets, massive concurrency, and infrastructure that needs to be private and reliable.

We're looking for a deeply hands-on, experienced engineer to help lead that build. This is someone who shapes core infrastructure and architecture decisions rather than just executing against a specification, and who naturally raises the level of the engineers working alongside them.

What You'll Do

Inference Optimizations

●      Implement custom kernels and low-level optimizations to push the absolute limits of GPU compute.

●      Apply graph optimization, operator fusion, and hardware-specific code generation at the ML compiler level.

●      Profile, analyze, and resolve deep system bottlenecks to radically improve latency, throughput, and memory efficiency.

●      Drive model-level execution improvements, including mixed precision and advanced quantization strategies.

Serving Optimizations

●      Write and optimize custom inference server backends to handle complex business logic, scripting, and state management.

●      Own and scale our overarching model serving infrastructure across multi-GPU, multi-node deployments to meet strict on-premise latency budgets.

●      Build robust, fault-tolerant runtime services, complete with comprehensive performance benchmarking and monitoring.


Requirements

●      8+ years of experience writing high-quality, high-performance code, including at least 5 years focused on machine learning systems.

●      Experience with one of C/C++/Rust and Python.

●      Deep familiarity with modern NVIDIA GPU architectures (e.g., Ada Lovelace, Blackwell), CUDA, and low-level system profiling.

●      Hands-on experience with ML compilers and optimization frameworks (e.g., Apache TVM, TorchInductor/Dynamo, TensorRT, Triton).

●      Experience building or extending model serving infrastructure, specifically writing custom C++ backends for Triton Inference Server (or similar serving engines).

●      Fluency in the AI serving stack, from kernels and quantization up to schedulers, state management, and autoscaling.

●      A record of shipping research or systems that other people build on, whether in a lab or in industry.

Nice-to-have:

●      Experience serving low-precision (FP4/FP8) models, multiple LoRA adapters within one model instance (Multi-LoRA), or models distributed across several GPU nodes.

●      A research-leaning or systems background in Speech (STT, TTS, S2S) or LLM inference, with work you can point to.

●      Experience operating large-scale, on-premise AI training or inference clusters, including bare-metal provisioning and Kubernetes management.

●      Familiarity with high-performance networking (InfiniBand or RoCE), distributed storage systems, and hardware health monitoring.

●      Experience maintaining or contributing to open-source ML or systems projects.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Palo Alto, CA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

AI answers unavailable

We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting