Back to jobs

Principal ML Ops Engineer (EMEA Remote)

Ukraine · Czech Republic · Latvia · Spain · Albania · Lithuania · Greece · Bosnia & Herzegovina · Croatia · Estonia · Serbia · Poland · Armenia · Portugal · Italy · Malta · Türkiye · Montenegro · Romania · Ukraine

Actively hiring, first seen by us 3 days ago
Pay
Pay not listed
Work setting
Remote — work setting source
Location: Fully remote (EMEA timezone) Start date: ASAP Languages: Fluent English required Industry: Cloud Computing / AI / European Deep-Tech SaaS About the Role
Location type: Remote
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Work with our Clients › EMEA — team source
Department: Work with our Clients › EMEA
From the employer’s posting

What you’ll work on

Full posting

Pragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services.

We are seeking a ML Ops Engineer with strong experience in production-grade model serving and infrastructure for AI systems.

  • Build and operate production model serving infrastructure (vLLM, TGI, Triton or similar)

  • Design blue/green and canary deployment pipelines for ML models

  • Develop auto-scaling, multi-model serving and request routing systems

  • Optimize GPU utilization, memory and network throughput

  • Own the full ML system lifecycle, including on-call support

From the employer’s posting
Pragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services. The company is redefining how compute is delivered by providing GPU-powered infrastructure for AI/ML workloads, secure storage, and high-speed data transfer through a decentralized architecture that significantly reduces environmental impact compared to traditional cloud providers.
We are seeking a ML Ops Engineer with strong experience in production-grade model serving and infrastructure for AI systems. This is a highly technical, hands-on role focused on building scalable, reliable, and efficient ML inference platforms powering real-time AI applications.
Build and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton, or equivalent
Design and implement robust deployment pipelines with blue/green and canary rollout strategies for ML models
Develop and maintain auto-scaling systems, multi-model serving architectures, and intelligent request routing layers
Optimize GPU utilization, memory efficiency, network throughput, and model artifact storage performance
Own the full lifecycle of ML systems from development through production, including operational support and on-call responsibilities

What you’ll bring

All qualifications

Core experience

  • 4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems
  • Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent
  • Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines
  • Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)
  • Strong understanding of distributed systems, performance tuning, and production reliability engineering
  • Ability to effectively use AI coding assistants to accelerate development and debugging workflows

Preferred experience

  • Experience with ML platforms such as Kubeflow, MLflow, or KubeAI
  • Proven experience building production systems from scratch rather than maintaining legacy platforms
  • Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems
  • Experience with cost optimization across different GPU types and inference workloads
Qualification wording
4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems
Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent
Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines
Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)
Strong understanding of distributed systems, performance tuning, and production reliability engineering
Ability to effectively use AI coding assistants to accelerate development and debugging workflows
Experience with ML platforms such as Kubeflow, MLflow, or KubeAI
Proven experience building production systems from scratch rather than maintaining legacy platforms
Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems
Experience with cost optimization across different GPU types and inference workloads
Apply at Pragmatike

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026
Employer says posted
Sep 23, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 7 and day 76.

From 6,389 similar postings that came down. Coming down is not always a hire.

Pragmatike is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • MLflow
  • Terraform
Where the posting names them
- Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines - Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar) - Strong understanding of distributed systems, performance tuning, and production reliability engineering
Preferred Qualifications - Experience with ML platforms such as Kubeflow, MLflow, or KubeAI - Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Location: Fully remote (EMEA timezone)
Start date: ASAP
Languages: Fluent English required
Industry: Cloud Computing / AI / European Deep-Tech SaaS

About the Role

Pragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services. The company is redefining how compute is delivered by providing GPU-powered infrastructure for AI/ML workloads, secure storage, and high-speed data transfer through a decentralized architecture that significantly reduces environmental impact compared to traditional cloud providers.

We are seeking a ML Ops Engineer with strong experience in production-grade model serving and infrastructure for AI systems. This is a highly technical, hands-on role focused on building scalable, reliable, and efficient ML inference platforms powering real-time AI applications.

You will be responsible for designing and operating the core infrastructure that serves machine learning models at scale. You will work closely with infrastructure, platform, and applied AI teams to ensure high availability, low latency, and cost-efficient inference systems. Strong ownership, production mindset, and experience with distributed GPU systems are essential.

Your Responsibilities

  • Build and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton, or equivalent

  • Design and implement robust deployment pipelines with blue/green and canary rollout strategies for ML models

  • Develop and maintain auto-scaling systems, multi-model serving architectures, and intelligent request routing layers

  • Optimize GPU utilization, memory efficiency, network throughput, and model artifact storage performance

  • Design observability systems for tracking inference latency, throughput, GPU usage, cost metrics, and system health

  • Manage model registries and CI/CD pipelines enabling automated and reproducible model deployments

  • Own the full lifecycle of ML systems from development through production, including operational support and on-call responsibilities

  • Define engineering best practices and contribute to platform scalability in a fast-moving startup environment

Required Qualifications

  • 4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems

  • Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent

  • Strong background in container orchestration and operating GPU-based workloads in production

  • Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines

  • Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)

  • Strong understanding of distributed systems, performance tuning, and production reliability engineering

  • Ability to effectively use AI coding assistants to accelerate development and debugging workflows

  • Ownership mindset with the ability to operate independently in a remote-first environment

Preferred Qualifications

  • Experience with ML platforms such as Kubeflow, MLflow, or KubeAI

  • Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems

  • Experience with cost optimization across different GPU types and inference workloads

  • Background in early-stage startups or greenfield infrastructure projects

  • Proven experience building production systems from scratch rather than maintaining legacy platforms

Why Join Us

  • Take ownership of critical infrastructure powering a rapidly scaling AI-native cloud platform

  • Build foundational ML inference systems from the ground up in a high-growth, well-funded startup

  • Work at the intersection of distributed systems, GPU computing, and sustainable cloud architecture

  • Gain deep expertise in next-generation AI infrastructure and large-scale model serving systems

  • Influence core engineering decisions and define best practices that will scale with the company.

Pragmatike is committed to a fair, transparent, and inclusive recruitment process. We do not discriminate based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation.

In accordance with GDPR, your personal data will be processed lawfully, fairly, and securely, and used solely for recruitment purposes, including sharing it with our client(s) for employment consideration.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Ukraine

Location: Fully remote (EMEA timezone) Start date: ASAP Languages: Fluent English required Industry: Cloud Computing / AI / European Deep-Tech SaaS About the Role
More source context
- Ability to effectively use AI coding assistants to accelerate development and debugging workflows - Ownership mindset with the ability to operate independently in a remote-first environment Preferred Qualifications
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.