You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes.
From the employer’s posting
We're hiring a Software Engineer to build the infrastructure that powers our AI agents and ML systems end-to-end — from fine-tuning foundation models to shipping production-grade agent harnesses. You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes. This role sits at the intersection of ML engineering, platform engineering, and applied AI.
Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
Education & alternatives
Must to Have:
- Bachelor’s or Master’s degree in Engineering, along with around 6+ years of experience in Python development, including building and supporting production systems
- Hands-on experience working with agent-based or agentic systems, using at least one framework such as LangGraph, CrewAI, AutoGen, LangChain, or LlamaIndex
Open 4 monthsWe first saw this posting 125 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
Status in our records
Live
First seen by us
Jul 20, 2026125 days ago
Recorded sightings
454
Last seen by us
Nov 21, 2026
Employer says posted
Jun 5, 2026
Jul 20, 2026today
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Time since we first saw it
Day 125
776
Up longer than most. Similar jobs usually come down between day 7 and day 76.
Well past Nokia’s usual: its jobs come down by about day 21.
From 6,389 similar postings that came down, and 17 of Nokia’s. Coming down is not always a hire.
Nokia is hiring
8 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
AWS
Azure
GCP
Kubernetes
MLflow
Airflow
Where the posting names them
We're hiring a Software Engineer to build the infrastructure that powers our AI agents and ML systems end-to-end — from fine-tuning foundation models to shipping production-grade agent harnesses. You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes. This role sits at the intersection of ML engineering, platform engineering, and applied AI.
- Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
- Develop and maintain a robust MLOps framework using Kubeflow and complementary tooling (MLflow, Argo, Airflow, or similar) to orchestrate training, evaluation, and deployment workflows
Must to Have:
- Bachelor’s or Master’s degree in Engineering, along with around 6+ years of experience in Python development, including building and supporting production systems
- Hands-on experience working with agent-based or agentic systems, using at least one framework such as LangGraph, CrewAI, AutoGen, LangChain, or LlamaIndex
- Experience deploying containerized applications on Kubernetes, including areas like Helm, operators, networking, and resource management
- Familiarity with at least one major cloud platform (AWS, GCP, or Azure), including services related to compute, storage, identity access management, and machine learning
- Understanding of software engineering practices such as modular design (SOLID principles), design patterns, secure coding practices, static analysis tools (for example, mypy, ruff, Bandit, SonarQube), and testing approaches (unit and integration testing)
We're hiring a Software Engineer to build the infrastructure that powers our AI agents and ML systems end-to-end — from fine-tuning foundation models to shipping production-grade agent harnesses. You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes. This role sits at the intersection of ML engineering, platform engineering, and applied AI.
- Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
- Fine-tune foundation LLMs using techniques such as LoRA/QLoRA, SFT, and RLHF; manage datasets, training runs, and evaluation pipelines
- Deploy and operate services on Kubernetes, including model serving, autoscaling, and observability
- Build and integrate AI agents using modern agent frameworks (LangGraph, CrewAI, AutoGen, LlamaIndex, or similar)
- Practical experience in fine-tuning large language models (for example, open-source models like Llama, Mistral, Qwen, or similar)
- Experience deploying containerized applications on Kubernetes, including areas like Helm, operators, networking, and resource management
- Familiarity with at least one major cloud platform (AWS, GCP, or Azure), including services related to compute, storage, identity access management, and machine learning
- Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
- Develop and maintain a robust MLOps framework using Kubeflow and complementary tooling (MLflow, Argo, Airflow, or similar) to orchestrate training, evaluation, and deployment workflows
- Fine-tune foundation LLMs using techniques such as LoRA/QLoRA, SFT, and RLHF; manage datasets, training runs, and evaluation pipelines
We're hiring a Software Engineer to build the infrastructure that powers our AI agents and ML systems end-to-end — from fine-tuning foundation models to shipping production-grade agent harnesses. You'll work across the stack: building MLOps pipelines, customizing LLMs, and deploying scalable agent systems on Kubernetes. This role sits at the intersection of ML engineering, platform engineering, and applied AI.
Design and build agent harnesses in Python — the runtime scaffolding that enables AI agents to perceive, reason, plan, and act reliably
Develop and maintain a robust MLOps framework using Kubeflow and complementary tooling (MLflow, Argo, Airflow, or similar) to orchestrate training, evaluation, and deployment workflows
Fine-tune foundation LLMs using techniques such as LoRA/QLoRA, SFT, and RLHF; manage datasets, training runs, and evaluation pipelines
Deploy and operate services on Kubernetes, including model serving, autoscaling, and observability
Build and integrate AI agents using modern agent frameworks (LangGraph, CrewAI, AutoGen, LlamaIndex, or similar)
Apply software engineering rigor — SOLID principles, secure coding, static analysis, code reviews, and CI/CD — across all deliverables
Collaborate with researchers, ML engineers, and product teams to take prototypes from notebook to production
Must to Have:
Bachelor’s or Master’s degree in Engineering, along with around 6+ years of experience in Python development, including building and supporting production systems
Hands-on experience working with agent-based or agentic systems, using at least one framework such as LangGraph, CrewAI, AutoGen, LangChain, or LlamaIndex
Exposure to designing or contributing to MLOps pipelines, with familiarity with tools like Kubeflow
Practical experience in fine-tuning large language models (for example, open-source models like Llama, Mistral, Qwen, or similar)
Experience deploying containerized applications on Kubernetes, including areas like Helm, operators, networking, and resource management
Familiarity with at least one major cloud platform (AWS, GCP, or Azure), including services related to compute, storage, identity access management, and machine learning
Understanding of software engineering practices such as modular design (SOLID principles), design patterns, secure coding practices, static analysis tools (for example, mypy, ruff, Bandit, SonarQube), and testing approaches (unit and integration testing)
Nice to Have:
Exposure to distributed training approaches, using tools such as DeepSpeed, FSDP, or Accelerate
Familiarity with vector databases, retrieval-augmented generation (RAG) systems, and evaluation frameworks for language models
Experience working with model serving solutions such as vLLM, TGI, KServe, or Triton
Demand for ML Engineer roles
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
US government figures for computer and information research scientists
Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.