Back to jobs

Software Engineer - ML Infrastructure

San Francisco · San Francisco, California, United States

Actively hiring, first seen by us 10 hours ago
Pay
Pay not listedSimilar roles state $119K–$194K
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering — team source
Department: Engineering
From the employer’s posting

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or in the future need visa sponsorship to work in the US?
From the employer’s application form

What you’ll bring

All qualifications

Core experience

  • Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.
  • Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.
  • Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.
  • Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.
  • Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.

Preferred experience

  • Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
Qualification wording
Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.
Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.
Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.
Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.
Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.
Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
Apply at Specter

Posting record

Report an error

Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 2026today
Recorded sightings
2
Last seen by us
Nov 19, 2026
Employer says posted
Oct 3, 2025

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$119K–$194K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 3,947 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 0

Early. Similar jobs usually come down between day 8 and day 59.

From 12,039 similar postings that came down. Coming down is not always a hire.

Specter is hiring

4 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C++
  • Python
  • Rust
  • PyTorch
  • TensorFlow
  • Go
Where the posting names them
Qualifications: - Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths. - Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling.
- Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths. - Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling. - Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Company Background
Specter's mission is to help automate the physical world.

Today, we build video sensors with state-of-the-art AI agents that answer any question, anywhere in their environments. Our systems can automatically detect and reason about any physical activity captured on camera, from security incidents (e.g. perimeter intrusion, theft, LPR), to safety monitoring (e.g. PPE detection, injured people), to operational efficiency (e.g. material tracking, congestion monitoring). We offer both long range wireless (1km range) and wired sensor variants to suit any deployment.

Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast approaching world of physical AI and robotics. We are a small, fast growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.


The Role
Specter is hiring an ML Infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the data, training, deployment, and serving infrastructure for the computer vision and VLM systems that enable autonomous monitoring and orchestration across our customers' physical assets.


Responsibilities:

  • Designing and implementing scalable ML training and inference pipelines for perception models (object detection, tracking, classification, segmentation) and VLMs.

  • Developing continuous training and evaluation systems to improve model performance from production data feedback loops.

  • Designing large-scale multi-modal data pipelines for ingesting, processing, and indexing video and sensor data spanning both batch and streaming workloads.

  • Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).

  • Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.

  • Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.

  • Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.

Qualifications:

  • Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths.

  • Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling.

  • Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.

  • Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.

  • Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.

  • Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.

  • Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.

  • Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.

Demand for Data Scientist roles

New Data Scientist postings at the employers we follow are up 4% over the last 6 weeks compared with the 6 before.

Weekly new Data Scientist postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 1,402, the most 2,948, and the latest week had 1,744.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Scientist, by the work the posting describes.

Data scientists use statistics and models to answer harder questions, such as whether a change worked, what demand will look like next quarter, or which customers are likely to leave.

Postings usually ask for Python or R, SQL, statistics, experiment design and common machine learning methods.

Unlike an ML engineer, a data scientist's main output is often an analysis or a first model, not software running inside a product.

US government figures for data scientists

Median yearly pay, May 2025
$120,230
Expected change, 2025 to 2035
34.6% more jobsagainst 3.5% for all jobs

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-2051.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

San Francisco, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.