Design and implement LLM-based and agentic AI solutions for business problems
Lead deployment and operation of production AI/ML and GenAI models on Azure, AWS or GCP
Run MLOps and LLMOps practices, including CI/CD, monitoring and evaluation
Build and apply RAG architectures, embeddings and vector search
Mentor engineers and provide technical leadership to cross-functional teams
From the employer’s posting
Design and implement advanced machine learning and AI solutions, including LLM-based applications and agentic AI systems
Lead the development, deployment, and operation of production AI/ML and GenAI models across major cloud platforms such as Azure, AWS, or GCP
Establish and maintain MLOps and LLMOps practices, including CI/CD pipelines, model lifecycle management, experiment tracking, evaluation, and monitoring
Develop and apply RAG architectures, embeddings, vector databases, prompt engineering, and LLM evaluation frameworks
Mentor engineers and provide technical leadership, collaborating with cross-functional teams
Proficiency in SQL and experience with large-scale structured and unstructured datasets
Hands-on experience building and deploying LLM-based applications
Expertise in agentic AI including agent orchestration, autonomous workflows, tool/function calling, planning, task decomposition, memory, and context management
Experience with MLOps and LLMOps, including CI/CD, model lifecycle management, experiment tracking, and production deployment
Proven experience deploying and operating AI/ML or GenAI models/applications in Azure, AWS, or GCP
Expertise in RAG architectures, embeddings, vector databases/vector search, prompt engineering, and LLM evaluation
Preferred experience
Experience building enterprise-grade agentic AI platforms or multi-agent systems
Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Information Technology, or a closely related discipline
Expertise with Databricks Model Serving, Vector Search, MLflow, Unity Catalog, and related Databricks AI/ML capabilities
Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
Qualification wording
Proficiency in SQL and experience with large-scale structured and unstructured datasets
Hands-on experience building and deploying LLM-based applications
Expertise in agentic AI including agent orchestration, autonomous workflows, tool/function calling, planning, task decomposition, memory, and context management
Experience with MLOps and LLMOps, including CI/CD, model lifecycle management, experiment tracking, and production deployment
Proven experience deploying and operating AI/ML or GenAI models/applications in Azure, AWS, or GCP
Expertise in RAG architectures, embeddings, vector databases/vector search, prompt engineering, and LLM evaluation
Experience building enterprise-grade agentic AI platforms or multi-agent systems
Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Information Technology, or a closely related discipline
Expertise with Databricks Model Serving, Vector Search, MLflow, Unity Catalog, and related Databricks AI/ML capabilities
Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
Education & alternatives
Desired Qualifications:
- Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Information Technology, or a closely related discipline
- Certification in machine learning, AI engineering, or data science from a recognized institution such as TensorFlow Developer Certificate or Databricks Certified Professional Data Scientist
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
AWS
Azure
Databricks
Docker
GCP
Kubernetes
MLflow
TensorFlow
Where the posting names them
Required Skills:
- Advanced hands-on programming experience in Python
- Proficiency in SQL and experience with large-scale structured and unstructured datasets
- Advanced hands-on programming experience in Python
- Proficiency in SQL and experience with large-scale structured and unstructured datasets
- Strong practical understanding of machine learning and AI fundamentals
- Design and implement advanced machine learning and AI solutions, including LLM-based applications and agentic AI systems, to address complex business challenges and deliver measurable business outcomes
- Lead the development, deployment, and operation of production AI/ML and GenAI models across major cloud platforms such as Azure, AWS, or GCP, ensuring high availability and scalability
- Build, orchestrate, and optimize AI agents and autonomous workflows, focusing on robust memory, context management, and multi-agent architectures
- Experience with MLOps and LLMOps, including CI/CD, model lifecycle management, experiment tracking, and production deployment
- Proven experience deploying and operating AI/ML or GenAI models/applications in Azure, AWS, or GCP
- Expertise in RAG architectures, embeddings, vector databases/vector search, prompt engineering, and LLM evaluation
- Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
- Experience with managed GenAI platforms such as Azure OpenAI, AWS Bedrock, or Google Vertex AI
- Experience with vector databases like Pinecone, Azure AI Search, Weaviate, or Databricks Vector Search
- Certification in machine learning, AI engineering, or data science from a recognized institution such as TensorFlow Developer Certificate or Databricks Certified Professional Data Scientist
- Certification in cloud platforms or MLOps, for example AWS Certified Machine Learning Specialist or Azure AI Engineer Associate
Employment type
- Experience with managed GenAI platforms such as Azure OpenAI, AWS Bedrock, or Google Vertex AI
- Experience with vector databases like Pinecone, Azure AI Search, Weaviate, or Databricks Vector Search
- Experience optimizing LLM applications for latency, throughput, scalability, token consumption, and cost
- Build, orchestrate, and optimize AI agents and autonomous workflows, focusing on robust memory, context management, and multi-agent architectures
- Drive enterprise AI/ML workloads within the Databricks ecosystem, leveraging Databricks AI Agents, Model Serving, Vector Search, MLflow, and Unity Catalog to enhance operational efficiency
- Establish and maintain MLOps and LLMOps practices, including CI/CD pipelines, model lifecycle management, experiment tracking, evaluation, and monitoring for continuous improvement
- Expertise in agentic AI including agent orchestration, autonomous workflows, tool/function calling, planning, task decomposition, memory, and context management
- Extensive hands-on experience with Databricks AI Agents and the Databricks ecosystem
- Experience with MLOps and LLMOps, including CI/CD, model lifecycle management, experiment tracking, and production deployment
- Experience building enterprise-grade agentic AI platforms or multi-agent systems
- Expertise with Databricks Model Serving, Vector Search, MLflow, Unity Catalog, and related Databricks AI/ML capabilities
- Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
- Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Information Technology, or a closely related discipline
- Certification in machine learning, AI engineering, or data science from a recognized institution such as TensorFlow Developer Certificate or Databricks Certified Professional Data Scientist
- Certification in cloud platforms or MLOps, for example AWS Certified Machine Learning Specialist or Azure AI Engineer Associate
- Expertise with Databricks Model Serving, Vector Search, MLflow, Unity Catalog, and related Databricks AI/ML capabilities
- Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
- Experience with managed GenAI platforms such as Azure OpenAI, AWS Bedrock, or Google Vertex AI
Experience Range: With at least 8 years of experience in AI/ML engineering, machine learning, data science, software engineering, or related fields Key Responsibilities:
Design and implement advanced machine learning and AI solutions, including LLM-based applications and agentic AI systems, to address complex business challenges and deliver measurable business outcomes
Lead the development, deployment, and operation of production AI/ML and GenAI models across major cloud platforms such as Azure, AWS, or GCP, ensuring high availability and scalability
Build, orchestrate, and optimize AI agents and autonomous workflows, focusing on robust memory, context management, and multi-agent architectures
Drive enterprise AI/ML workloads within the Databricks ecosystem, leveraging Databricks AI Agents, Model Serving, Vector Search, MLflow, and Unity Catalog to enhance operational efficiency
Establish and maintain MLOps and LLMOps practices, including CI/CD pipelines, model lifecycle management, experiment tracking, evaluation, and monitoring for continuous improvement
Develop and apply RAG architectures, embeddings, vector databases, prompt engineering, and LLM evaluation frameworks to improve model performance and reliability
Ensure AI security, responsible AI practices, data privacy, and effective mitigation of hallucination, prompt injection, and GenAI guardrails
Mentor engineers and provide technical leadership, collaborating with cross-functional teams to deliver scalable, enterprise-grade AI solutions
Required Skills:
Advanced hands-on programming experience in Python
Proficiency in SQL and experience with large-scale structured and unstructured datasets
Strong practical understanding of machine learning and AI fundamentals
Hands-on experience building and deploying LLM-based applications
Expertise in agentic AI including agent orchestration, autonomous workflows, tool/function calling, planning, task decomposition, memory, and context management
Extensive hands-on experience with Databricks AI Agents and the Databricks ecosystem
Experience with MLOps and LLMOps, including CI/CD, model lifecycle management, experiment tracking, and production deployment
Proven experience deploying and operating AI/ML or GenAI models/applications in Azure, AWS, or GCP
Expertise in RAG architectures, embeddings, vector databases/vector search, prompt engineering, and LLM evaluation
Proficiency with LLM and GenAI frameworks/orchestration tools such as LangChain, LangGraph, Semantic Kernel, or similar technologies
Preferred Skills:
Experience building enterprise-grade agentic AI platforms or multi-agent systems
Expertise with Databricks Model Serving, Vector Search, MLflow, Unity Catalog, and related Databricks AI/ML capabilities
Experience with Kubernetes, Docker, REST APIs, microservices, and CI/CD pipelines
Experience with managed GenAI platforms such as Azure OpenAI, AWS Bedrock, or Google Vertex AI
Experience with vector databases like Pinecone, Azure AI Search, Weaviate, or Databricks Vector Search
Experience optimizing LLM applications for latency, throughput, scalability, token consumption, and cost
Desired Qualifications:
Bachelor's degree in Computer Science, Data Science, Artificial Intelligence, Information Technology, or a closely related discipline
Certification in machine learning, AI engineering, or data science from a recognized institution such as TensorFlow Developer Certificate or Databricks Certified Professional Data Scientist
Certification in cloud platforms or MLOps, for example AWS Certified Machine Learning Specialist or Azure AI Engineer Associate
Employment type
Employee
Demand for ML Engineer roles
New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under ML Engineer, by the work the posting describes.
ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.
Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.
A data scientist often works out which model to build; an ML engineer makes it run reliably in production.
US government figures for computer and information research scientists
Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs
The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.