We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS.
We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS.
Design and build LLM applications, RAG pipelines and multi-step agents
Build and deploy models and AI services on AWS
Set up offline evaluation, regression checks and quality, latency and cost tracking
Add observability and tracing for AI workloads
Build in guardrails, prompt-injection defences and access control from the start
From the employer’s posting
We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS. This includes large language model (LLM) applications, AI agents, retrieval-augmented generation (RAG), and classic machine learning. You’ll take ideas from prototype to production, with a focus on reliability, security, cost and measurable quality. The role is hired at two levels.
Design and build LLM applications: prompt design, RAG pipelines, tool or function calling, and multi-step agents.
Build and deploy models and AI services on AWS: Amazon Bedrock, SageMaker, Lambda, API Gateway, ECS/EKS, Step Functions, DynamoDB, S3 and OpenSearch.
Set up evaluation: offline test sets, LLM-as-judge, regression checks, and tracking of quality, latency and cost.
Add observability and tracing for AI workloads, for example OpenTelemetry, CloudWatch, LangFuse or similar.
Build in safety from the start: guardrails, prompt-injection defences, access control, human approval for risky actions, and handling of personal data.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
AWS
Docker
DynamoDB
Kubernetes
MLflow
S3
SageMaker
Terraform
Where the posting names them
AI/ML Engineer (about 3–6 years)
- Strong Python; solid software engineering (testing, code review, APIs, Git).
- Hands-on experience shipping at least one LLM or ML system to production.
- Security awareness: OAuth/OIDC, least-privilege IAM, secrets management.
- Good Python and ML fundamentals (supervised learning, model evaluation, basic statistics).
- A degree in CS, Data Science or a related field, or equivalent practical experience.
Aufgaben
Job Description: AI/ML Engineer (AWS)
About the role
About the role
We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS. This includes large language model (LLM) applications, AI agents, retrieval-augmented generation (RAG), and classic machine learning. You’ll take ideas from prototype to production, with a focus on reliability, security, cost and measurable quality. The role is hired at two levels.
Responsibilities
- Design and build LLM applications: prompt design, RAG pipelines, tool or function calling, and multi-step agents.
- Build and deploy models and AI services on AWS: Amazon Bedrock, SageMaker, Lambda, API Gateway, ECS/EKS, Step Functions, DynamoDB, S3 and OpenSearch.
- Set up evaluation: offline test sets, LLM-as-judge, regression checks, and tracking of quality, latency and cost.
- Work with product, platform and security teams; write clear design documents and runbooks.
- Keep up with the field and assess new models, frameworks and AWS services.
Requirements
- Hands-on experience shipping at least one LLM or ML system to production.
- Practical AWS experience: Bedrock and/or SageMaker, Lambda, IAM, VPC basics, and serverless or container deployment.
- Experience with RAG and vector search (OpenSearch, pgvector or similar) and embeddings.
- Hands-on project work with LLM APIs, RAG or ML models (internships, open source or personal projects count).
- Familiarity with core AWS services; an AWS certification is a plus.
- Eagerness to learn production engineering practices: testing, monitoring and security.
Nice to have
- AWS certifications: Machine Learning Engineer – Associate, AI Practitioner, Solutions Architect. Fine-tuning or adapting models (LoRA, distillation) and MLOps tools (MLflow, SageMaker Pipelines).
- Experience with multi-agent systems, agent-to-agent (A2A) communication, or policy engines.
- Experience with multi-agent systems, agent-to-agent (A2A) communication, or policy engines.
- Docker, Kubernetes (EKS) and Linux.
- Experience with responsible-AI practices and governance.
- Build in safety from the start: guardrails, prompt-injection defences, access control, human approval for risky actions, and handling of personal data.
- Write production-quality, tested code and maintain CI/CD and infrastructure as code (Terraform or CDK).
- Work with product, platform and security teams; write clear design documents and runbooks.
- Understanding of evaluation methods, model limits, hallucination, and cost and latency trade-offs.
- Infrastructure as code (Terraform or CDK) and CI/CD.
- Security awareness: OAuth/OIDC, least-privilege IAM, secrets management.
We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS. This includes large language model (LLM) applications, AI agents, retrieval-augmented generation (RAG), and classic machine learning. You’ll take ideas from prototype to production, with a focus on reliability, security, cost and measurable quality. The role is hired at two levels.
Responsibilities
Design and build LLM applications: prompt design, RAG pipelines, tool or function calling, and multi-step agents.
Build and deploy models and AI services on AWS: Amazon Bedrock, SageMaker, Lambda, API Gateway, ECS/EKS, Step Functions, DynamoDB, S3 and OpenSearch.
Set up evaluation: offline test sets, LLM-as-judge, regression checks, and tracking of quality, latency and cost.
Add observability and tracing for AI workloads, for example OpenTelemetry, CloudWatch, LangFuse or similar.
Build in safety from the start: guardrails, prompt-injection defences, access control, human approval for risky actions, and handling of personal data.
Write production-quality, tested code and maintain CI/CD and infrastructure as code (Terraform or CDK).
Work with product, platform and security teams; write clear design documents and runbooks.
Keep up with the field and assess new models, frameworks and AWS services.
Good Python and ML fundamentals (supervised learning, model evaluation, basic statistics).
A degree in CS, Data Science or a related field, or equivalent practical experience.
Hands-on project work with LLM APIs, RAG or ML models (internships, open source or personal projects count).
Familiarity with core AWS services; an AWS certification is a plus.
Eagerness to learn production engineering practices: testing, monitoring and security.
Nice to have
AWS certifications: Machine Learning Engineer – Associate, AI Practitioner, Solutions Architect. Fine-tuning or adapting models (LoRA, distillation) and MLOps tools (MLflow, SageMaker Pipelines).
Experience with multi-agent systems, agent-to-agent (A2A) communication, or policy engines.
Docker, Kubernetes (EKS) and Linux.
Experience with responsible-AI practices and governance.
What we look for
Clear thinking and plain communication with technical and non-technical colleagues.
Ownership: builds, measures and improves things end to end.
Judgement about when AI is, and isn’t, the right tool.
Qualifikationen
Job Description: AI/ML Engineer
About the role
We’re looking for an AI/ML engineer to design, build and run AI-powered applications on AWS. This includes large language model (LLM) applications, AI agents, retrieval-augmented generation (RAG), and classic machine learning. You’ll take ideas from prototype to production, with a focus on reliability, security, cost and measurable quality. The role is hired at two levels.
Responsibilities
Design and build LLM applications: prompt design, RAG pipelines, tool or function calling, and multi-step agents.
Build and deploy models and AI services on AWS: Amazon Bedrock, SageMaker, Lambda, API Gateway, ECS/EKS, Step Functions, DynamoDB, S3 and OpenSearch.
Set up evaluation: offline test sets, LLM-as-judge, regression checks, and tracking of quality, latency and cost.
Add observability and tracing for AI workloads, for example OpenTelemetry, CloudWatch, LangFuse or similar.
Build in safety from the start: guardrails, prompt-injection defences, access control, human approval for risky actions, and handling of personal data.
Write production-quality, tested code and maintain CI/CD and infrastructure as code (Terraform or CDK).
Work with product, platform and security teams; write clear design documents and runbooks.
Keep up with the field and assess new models, frameworks and AWS services.
Good Python and ML fundamentals (supervised learning, model evaluation, basic statistics).
A degree in CS, Data Science or a related field, or equivalent practical experience.
Hands-on project work with LLM APIs, RAG or ML models (internships, open source or personal projects count).
Familiarity with core AWS services; an AWS certification is a plus.
Eagerness to learn production engineering practices: testing, monitoring and security.
Nice to have
AWS certifications: Machine Learning Engineer – Associate, AI Practitioner, Solutions Architect. Fine-tuning or adapting models (LoRA, distillation) and MLOps tools (MLflow, SageMaker Pipelines).
Experience with multi-agent systems, agent-to-agent (A2A) communication, or policy engines.
Docker, Kubernetes (EKS) and Linux.
Experience with responsible-AI practices and governance.
What we look for
Clear thinking and plain communication with technical and non-technical colleagues.
Ownership: builds, measures and improves things end to end.
Judgement about when AI is, and isn’t, the right tool.
Demand for AI Engineer roles
New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.