Pay
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,537 postings in the last year. Stated ranges, not salaries paid.
San Francisco Bay Area · San Francisco Bay Area, California, United States
Open 5 months, first seen by us 172 days agoLocation type: On-siteFrom the employer’s posting
Employment type: Full-timeFrom the employer’s posting
Department: EngineeringFrom the employer’s posting
Our AI Lab is pioneering the future of intelligent infrastructure through open-source LLMs, agent-native pipelines, retrieval-augmented generation (RAG), and knowledge-graph-grounded models.
We’re hiring an ML Ops Engineer to be the glue between ML research and production systems — responsible for automating the model training, deployment, versioning, and observability pipelines that power our agents and AI data fabric.
Build pipelines for LLM fine-tuning (SFT, LoRA, RLHF, DPO) and RAG embedding updates
Manage hybrid GPU compute for training and inference on Kubernetes, Ray, and Terraform
Containerize models and agents with Docker and set up CI/CD pipelines
Implement model governance: versioning, lineage, reproducibility, and evaluation capture
Instrument monitoring for model latency, token usage, errors, and drift
Our AI Lab is pioneering the future of intelligent infrastructure through open-source LLMs, agent-native pipelines, retrieval-augmented generation (RAG), and knowledge-graph-grounded models.
We’re hiring an ML Ops Engineer to be the glue between ML research and production systems — responsible for automating the model training, deployment, versioning, and observability pipelines that power our agents and AI data fabric.
Build and maintain secure, scalable, and automated pipelines for: LLM fine-tuning, SFT, LoRA, RLHF, DPO training RAG embedding pipelines with dynamic updates
Manage hybrid compute infrastructure (cloud, on-prem, GPU clusters) for training and inference workloads using Kubernetes, Ray, and Terraform
Containerize models and agents using Docker, with reproducible builds and CI/CD via GitHub Actions or ArgoCD
Implement and enforce model governance: versioning, metadata, lineage, reproducibility, and evaluation capture
Instrument observability for model latency, token usage, performance metrics, error tracing, and drift detection
5+ years as a full stack or backend engineer
Experience owning and delivering production systems end-to-end
Prior experience with modern frontend frameworks (React, Next.js)
Familiarity with building APIs, databases, cloud infrastructure, or deployment workflows at scale
4+ years in MLOps, ML platform engineering, or infra-focused ML roles
Experience with large model deployments (open-source LLMs preferred): LLaMA,
Experience with policy-as-code systems (OPA, Rego) and access layers
Deep familiarity with model lifecycle management tools: MLflow, Weights & Biases, DVC,
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$166K–$237K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 1,537 postings in the last year. Stated ranges, not salaries paid.
Day 172
Up longer than most. Similar jobs usually come down between day 7 and day 76.
From 6,389 similar postings that came down. Coming down is not always a hire.
4 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Security: OPA (Rego), Keycloak, Vault - Languages: Python (primary), Bash, optionally Rust or Go for tooling Mindset & Culture Fit
inference workloads using Kubernetes, Ray, and Terraform - Containerize models and agents using Docker, with reproducible builds and CI/CD via GitHub Actions or ArgoCD
- Pipelines: Prefect, Airflow, Dagster - Monitoring: Prometheus, Grafana, OpenTelemetry, LangSmith - Security: OPA (Rego), Keycloak, Vault
- Manage hybrid compute infrastructure (cloud, on-prem, GPU clusters) for training and inference workloads using Kubernetes, Ray, and Terraform - Containerize models and agents using Docker, with reproducible builds and CI/CD via
- LLM Ops: HuggingFace, DeepSpeed, MLflow, Weights & Biases, DVC - Infra: Kubernetes (GKE/EKS), Ray, Terraform, Helm, GitHub Actions, ArgoCD - Serving: vLLM, TGI, Triton, Ray Serve
- 4+ years in MLOps, ML platform engineering, or infra-focused ML roles - Deep familiarity with model lifecycle management tools: MLflow, Weights & Biases, DVC, - HuggingFace Hub
Preferred Stack - LLM Ops: HuggingFace, DeepSpeed, MLflow, Weights & Biases, DVC - Infra: Kubernetes (GKE/EKS), Ray, Terraform, Helm, GitHub Actions, ArgoCD
- Managed hybrid workloads across GPU cloud (Lambda, Modal, HuggingFace Inference, - Sagemaker) - Familiar with cost optimization (spot instance scaling, batch prioritization, model sharding)
Automation + Infra: - Proficient with Terraform, Helm, K8s, and container orchestration - Experience with CI/CD for ML (e.g. GitHub Actions + model checkpoints)
- Serving: vLLM, TGI, Triton, Ray Serve - Pipelines: Prefect, Airflow, Dagster - Monitoring: Prometheus, Grafana, OpenTelemetry, LangSmith
- Deep familiarity with model lifecycle management tools: MLflow, Weights & Biases, DVC, - HuggingFace Hub - Experience with large model deployments (open-source LLMs preferred): LLaMA,
- Mistral, Falcon, Mixtral - Comfortable with tuning libraries (HuggingFace Trainer, DeepSpeed, FSDP, QLoRA) - Familiarity with inference serving: vLLM, TGI, Ray Serve, Triton Inference Server
- Experience with CI/CD for ML (e.g. GitHub Actions + model checkpoints) - Managed hybrid workloads across GPU cloud (Lambda, Modal, HuggingFace Inference, - Sagemaker)
- Experience owning and delivering production systems end-to-end - Prior experience with modern frontend frameworks (React, Next.js) - Familiarity with building APIs, databases, cloud infrastructure, or deployment workflows at scale
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
ML Ops Engineer — Agentic AI Lab (Founding Team)
Location: San Francisco Bay Area
Type: Full-Time
Compensation: Competitive salary + meaningful equity (founding tier)
Backed by 8VC, we're building a world-class team to tackle one of the industry’s most critical infrastructure problems.
Our AI Lab is pioneering the future of intelligent infrastructure through open-source LLMs, agent-native pipelines, retrieval-augmented generation (RAG), and knowledge-graph-grounded models.
We’re hiring an ML Ops Engineer to be the glue between ML research and production systems — responsible for automating the model training, deployment, versioning, and observability pipelines that power our agents and AI data fabric.
You’ll work across compute orchestration, GPU infrastructure, fine-tuned model lifecycle management, model governance, and security e
Responsibilities
Build and maintain secure, scalable, and automated pipelines for:
LLM fine-tuning, SFT, LoRA, RLHF, DPO training
RAG embedding pipelines with dynamic updates
Model conversion, quantization, and inference rollout
Manage hybrid compute infrastructure (cloud, on-prem, GPU clusters) for training and
inference workloads using Kubernetes, Ray, and Terraform
Containerize models and agents using Docker, with reproducible builds and CI/CD via
GitHub Actions or ArgoCD
Implement and enforce model governance: versioning, metadata, lineage, reproducibility,
and evaluation capture
Create and manage evaluation and benchmarking frameworks (e.g. OpenLLM-Evals,
RAGAS, LangSmith)
Integrate with security and access control layers (OPA, ABAC, Keycloak) to enforce
model policies per tenant
Instrument observability for model latency, token usage, performance metrics, error
tracing, and drift detection
Support deployment of agentic apps with LangGraph, LangChain, and custom inference
backends (e.g. vLLM, TGI, Triton)
Model Infrastructure:
4+ years in MLOps, ML platform engineering, or infra-focused ML roles
Deep familiarity with model lifecycle management tools: MLflow, Weights & Biases, DVC,
HuggingFace Hub
Experience with large model deployments (open-source LLMs preferred): LLaMA,
Mistral, Falcon, Mixtral
Comfortable with tuning libraries (HuggingFace Trainer, DeepSpeed, FSDP, QLoRA)
Familiarity with inference serving: vLLM, TGI, Ray Serve, Triton Inference Server
Automation + Infra:
Proficient with Terraform, Helm, K8s, and container orchestration
Experience with CI/CD for ML (e.g. GitHub Actions + model checkpoints)
Managed hybrid workloads across GPU cloud (Lambda, Modal, HuggingFace Inference,
Sagemaker)
Familiar with cost optimization (spot instance scaling, batch prioritization, model sharding)
Agent + Data Pipeline Support:●
Familiarity with LangChain, LangGraph, LlamaIndex or similar RAG/agent orchestration tools
Built embedding pipelines for multi-source documents (PDF, JSON, CSV, HTML)
Integrated with vector databases (Weaviate, Qdrant, FAISS, Chroma)
Security & Governance:
Implemented model-level RBAC, usage tracking, audit trails
Integrated with API rate limits, tenant billing, and SLA observability
Experience with policy-as-code systems (OPA, Rego) and access layers
Preferred Stack
LLM Ops: HuggingFace, DeepSpeed, MLflow, Weights & Biases, DVC
Infra: Kubernetes (GKE/EKS), Ray, Terraform, Helm, GitHub Actions, ArgoCD
Serving: vLLM, TGI, Triton, Ray Serve
Pipelines: Prefect, Airflow, Dagster
Monitoring: Prometheus, Grafana, OpenTelemetry, LangSmith
Security: OPA (Rego), Keycloak, Vault
Languages: Python (primary), Bash, optionally Rust or Go for tooling
Mindset & Culture Fit
Builder's mindset with startup autonomy: you automate what slows you down
Obsessive about reproducibility, observability, and traceability
Comfortable with a hybrid team of AI researchers, DevOps, and backend engineers
Interested in aligning ML systems to product delivery, not just papers
Bonus: experience with SOC2, HIPAA, or GovCloud-grade model operations
Experience:
5+ years as a full stack or backend engineer
Experience owning and delivering production systems end-to-end
Prior experience with modern frontend frameworks (React, Next.js)
Familiarity with building APIs, databases, cloud infrastructure, or deployment workflows at scale
Comfortable working in early-stage startups or autonomous roles, prior experience as a founder, founding engineer, or a 0-1 pre-seed startup is a big plus
Mindset:
Comfortable with ambiguity, eager to prototype and iterate quickly
Strong sense of ownership — prefers to build systems rather than wait for tickets
Enjoys thinking about architecture, performance, and tradeoffs at every level
Clear communicator and pragmatic team player
Values equity and impact over prestige or hierarchy
Prior startup or founding team experience
Your work will enable models and agents to be trained, evaluated, deployed, and governed at
scale — across many tenants, models, and tasks. This is the backbone of a secure, reliable,
and scalable AI-native enterprise system. If you dream about using AI to solve some really hard
real world problems – we would love to hear from you.
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
San Francisco Bay Area, California, United States
- Model conversion, quantization, and inference rollout - Manage hybrid compute infrastructure (cloud, on-prem, GPU clusters) for training and inference workloads using Kubernetes, Ray, and Terraform
- Experience with CI/CD for ML (e.g. GitHub Actions + model checkpoints) - Managed hybrid workloads across GPU cloud (Lambda, Modal, HuggingFace Inference, - Sagemaker)
More relevant text appears in the full description.
No clear work-authorization passage found. Eligibility is unconfirmed.