Back to jobs

Embedding MLOps

Pay
Pay not listed
Work setting
On-site — work setting source
Work setup in the employer’s posting: IN_OFFICE
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Design a multi-tenanted, cloud-native embedding infrastructure for training and inference

  • Build scalable vector search and embedding generation services with low latency

  • Implement fault-tolerant systems for serving embedding models at scale

  • Create pipelines that generate and update embeddings from text, images, and audio

  • Optimize embedding storage, indexing, and retrieval for performance and cost

From the employer’s posting
Design and architect a multi-tenanted, cloud-native embedding infrastructure that supports both training and inference workloads.
Build scalable vector search and embedding generation services that handle high throughput, maintain low latency, and measure index time.
Implement fault-tolerant, high-performance systems for serving embedding models at scale.
Create scalable pipelines for generating and updating embeddings from various data sources (text, images, audio).
Optimize embedding storage, indexing, and retrieval systems for performance and cost efficiency.

What you’ll bring

All qualifications

Core experience

  • Bachelor's degree in Computer Science, Engineering, or related technical field
  • 2+ years of experience building large-scale, high-performance backend systems9
  • 2+ years of experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools39
  • Strong proficiency in at least one programming language such as Python, Go, C++, or Java.
  • Experience with containerization and orchestration technologies (Docker, Kubernetes).
  • Knowledge of distributed systems concepts like sharding, replication, and consensus algorithms.

Preferred experience

  • Master's preferred
  • Experience with vector databases and similarity search systems (FAISS, Pinecone, Milvus, etc.).
  • Knowledge of ML frameworks (PyTorch, TensorFlow) and model optimization techniques.
  • Experience with SOTA embedding models from a variety of domains (CV, LLMs, etc.).
Qualification wording
Bachelor's degree in Computer Science, Engineering, or related technical field (Master's preferred).
2+ years of experience building large-scale, high-performance backend systems9
2+ years of experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools39
Strong proficiency in at least one programming language such as Python, Go, C++, or Java.
Experience with containerization and orchestration technologies (Docker, Kubernetes).
Knowledge of distributed systems concepts like sharding, replication, and consensus algorithms.
Experience with vector databases and similarity search systems (FAISS, Pinecone, Milvus, etc.).
Knowledge of ML frameworks (PyTorch, TensorFlow) and model optimization techniques.
Experience with SOTA embedding models from a variety of domains (CV, LLMs, etc.).
Education & alternatives
Requirements - Bachelor's degree in Computer Science, Engineering, or related technical field (Master's preferred). - 2+ years of experience building large-scale, high-performance backend systems9

About Interpretai-Tech

Our infrastructure team is focused on building scalable, reliable systems that powers data instrospection and data curation platforms.

In the employer’s words · Read in context

Apply at Interpretai-Tech

Posting record

Report an error

Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 2, 2026172 days ago
Recorded sightings
82
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 172

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

Interpretai-Tech is hiring

1 open job

  • No new data jobs since June
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C++
  • Java
  • Python
  • AWS
  • Azure
  • Docker
  • GCP
  • Kubernetes
  • PyTorch
  • TensorFlow
  • Go
Where the posting names them
- 2+ years of experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools39 - Strong proficiency in at least one programming language such as Python, Go, C++, or Java. - Experience with containerization and orchestration technologies (Docker, Kubernetes).
- 2+ years of experience building large-scale, high-performance backend systems9 - 2+ years of experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools39 - Strong proficiency in at least one programming language such as Python, Go, C++, or Java.
You'll be working with technologies including: - Cloud environments (AWS/GCP/Azure) - Kubernetes for container orchestration
- Strong proficiency in at least one programming language such as Python, Go, C++, or Java. - Experience with containerization and orchestration technologies (Docker, Kubernetes). - Knowledge of distributed systems concepts like sharding, replication, and consensus algorithms.
- Cloud environments (AWS/GCP/Azure) - Kubernetes for container orchestration - Vector databases and search engines
- Experience with vector databases and similarity search systems (FAISS, Pinecone, Milvus, etc.). - Knowledge of ML frameworks (PyTorch, TensorFlow) and model optimization techniques. - Experience with SOTA embedding models from a variety of domains (CV, LLMs, etc.).

Your next step

Complete your application on jobs.gem.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Embedding Cluster Engineer: Cloud Infrastructure Specialist

Summary

We are seeking an experienced Cluster Infrastructure Engineer to design, implement, and maintain our vector embedding infrastructure on cloud platforms and support our distributed training platform on the cloud. In this role, you will be responsible for creating a scalable, high-performance system that supports both the training of embedding models and efficient inference workflows. The ideal candidate will combine expertise in machine learning infrastructure with strong system design skills to build robust embedding systems that power our AI applications, including vector searches, recommendations, and SOTA model inference for foundation models.

Key Responsibilities

  • Design and architect a multi-tenanted, cloud-native embedding infrastructure that supports both training and inference workloads.
  • Build scalable vector search and embedding generation services that handle high throughput, maintain low latency, and measure index time.
  • Implement fault-tolerant, high-performance systems for serving embedding models at scale.
  • Develop infrastructure automation using containerization, orchestration, and infrastructure-as-code practices.
  • Optimize embedding storage, indexing, and retrieval systems for performance and cost efficiency.
  • Design and implement robust monitoring and observability solutions to ensure system health and performance.
  • Collaborate with ML engineers and data scientists to understand and support embedding-related workloads.
  • Create scalable pipelines for generating and updating embeddings from various data sources (text, images, audio).
  • Implement security best practices and ensure compliance with data protection requirements3
  • Lead technical discussions regarding vector database architecture and performance optimization.
  • Support hiring efforts for building the core infrastructure.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or related technical field (Master's preferred).
  • 2+ years of experience building large-scale, high-performance backend systems9
  • 2+ years of experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools39
  • Strong proficiency in at least one programming language such as Python, Go, C++, or Java.
  • Experience with containerization and orchestration technologies (Docker, Kubernetes).
  • Knowledge of distributed systems concepts like sharding, replication, and consensus algorithms.
  • Demonstrated experience with database systems, search technologies, or AI/ML systems8
  • Understanding of embedding techniques and their applications for text, images, or other data types.
  • Experience with memory management, networking, and troubleshooting distributed systems.
  • Proven ability to solve complex problems independently in fast-moving environments.

Preferred Qualifications

  • Experience with vector databases and similarity search systems (FAISS, Pinecone, Milvus, etc.).
  • Knowledge of ML frameworks (PyTorch, TensorFlow) and model optimization techniques.
  • Experience with SOTA embedding models from a variety of domains (CV, LLMs, etc.).
  • Understanding of embedding evaluation metrics and quality assessment techniques.
  • Experience with high-performance computing (HPC) environments.
  • Background in designing systems for machine learning training and/or inference workloads.
  • Knowledge of data sharding strategies, parallel processing, and memory optimization techniques.
  • Experience with real-time streaming data processing frameworks.
  • Contributions to open-source projects related to embeddings or machine learning infrastructure.

Impact of This Role

As an Embedding Cluster Engineer, you will build the foundation for our AI capabilities. Your work will enable our company to efficiently process unstructured data, power advanced search capabilities, enhance recommendation systems, and improve the accuracy of our introspection platform for our customers. Your infrastructure will be critical to both the training and deployment of our embedding models, directly impacting the speed and quality of our AI services.

About Our Team

Our infrastructure team is focused on building scalable, reliable systems that powers data instrospection and data curation platforms. We value collaboration, innovation, and a strong focus on production excellence. You'll work closely with machine learning engineers, data scientists, and other infrastructure specialists to create systems that turn cutting-edge research into production-ready services.

Technical Environment

You'll be working with technologies including:
  • Cloud environments (AWS/GCP/Azure)
  • Kubernetes for container orchestration
  • Vector databases and search engines
  • Distributed computing frameworks
  • ML model serving platforms
  • Infrastructure automation tools
  • Monitoring and observability solutions

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

SF

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.