Back to jobs

Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering

Pay
Multiple pay amounts — pay source
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. USA, CA, East Palo Alto - 165,200.00 - 223,600.00 USD annually USA, MA, Boston - 143,700.00 - 194,400.00 USD annually USA, NY, New York - 158,100.00 - 213,800.00 USD annually USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: full-time
From the employer’s posting

Before you apply

Employer’s visa record
31,079 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
- 3+ years of non-internship professional software development experience - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language - Hands-on experience with generative AI technology, such as LLMs, vision-language models, or speech models Preferred qualifications - Bachelor's degree in computer science or equivalent - Experience with large-scale distributed training of LLMs on multi-node accelerator clusters, using frameworks such as PyTorch FSDP2, TorchTitan, Megatron-LM/Megatron Core, NeMo, DeepSpeed, or NeuronX Distributed - Experience with LLM post-training, including SFT, DPO, RLHF, and RL with verifiable rewards or multi-turn agentic RL, using frameworks such as Miles, slime, verl, NeMo-RL, OpenRLHF, SkyRL, or TRL - Experience optimizing model training or inference for latency, throughput, or cost, using serving engines such as SGLang, vLLM, or TensorRT-LLM, on AWS Trainium or Inferentia (Neuron SDK), on AWS services such as SageMaker AI, SageMaker HyperPod, or EKS, or by writing custom kernels (CUDA, Triton, NKI) - Experience deploying and operating ML models in customer production environments, working with teams that build and scale end-to-end production systems Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Apply at Amazon

Posting record

Report an error

Actively hiringFirst seen by us 4 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 13, 20264 days ago
Recorded sightings
5
Last seen by us
Nov 17, 2026
Employer says posted
Oct 27, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Amazon is hiring

582 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • 1% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • AWS
  • SageMaker
  • PyTorch
Where the posting names them
As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with strategic customers to build, optimize, and run custom generative AI models in production alongside their engineering teams. You own complete model workstreams end-to-end from defining the evaluation bar and preparing data, through training and inference optimization, to production deployment. FDE IIs on this team works at the intersection of models and systems. They customize state-of-the-art open-weight and foundation models for new domains, languages, and modalities; migrate and optimize training and inference workloads on AWS Trainium and operate those models as production services. They are autonomous contributors who take on projects where the business goal is clear, but the path is not. They make design trade-offs with appropriate guidance, limit short-term workarounds, coach others on producing high-quality code, and train new team members. Key job responsibilities Embed within customer ML and engineering teams: Understand the customer's business, data, model stack, and operational constraints. Translate ambiguous goals into a measurable evaluation bar and a technical plan for your workstream such as model selection, customization approach, and serving architecture. Requires up to 25% travel.
Build large-scale training and inference systems. Design and implement distributed training and RL post-training pipelines using frameworks such as PyTorch FSDP2, Megatron-LM, Miles, and verl. Build RL interaction harnesses using NeMo Gym or OpenEnv to connect agent workflows, tools, environments, and reward functions to training. Develop production inference stacks with engines such as SGLang and vLLM, and optimize throughput, latency, memory footprint, and cost per token through quantization, parallelism, speculative decoding, and batching. Optimize models on AWS chips. Migrate and tune training and inference workloads for AWS Trainium using the AWS Neuron SDK. Profile performance, close accuracy-parity gaps against GPU baselines, and develop custom kernels where needed. Benchmark rigorously and turn results into decisions customers can act on. Accelerate impact beyond the engagement. Codify reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and optimization patterns that accelerate future deployments. Feed field learnings back to AWS service teams, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron. Identify opportunities to expand model customization and optimization within your customer engagement.
Optimize models on AWS chips. Migrate and tune training and inference workloads for AWS Trainium using the AWS Neuron SDK. Profile performance, close accuracy-parity gaps against GPU baselines, and develop custom kernels where needed. Benchmark rigorously and turn results into decisions customers can act on. Accelerate impact beyond the engagement. Codify reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and optimization patterns that accelerate future deployments. Feed field learnings back to AWS service teams, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron. Identify opportunities to expand model customization and optimization within your customer engagement. About the team The Custom Model and Optimization team, part of the Forward Deployed Engineering team partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference workloads onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers' most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS.
Accelerate impact beyond the engagement. Codify reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and optimization patterns that accelerate future deployments. Feed field learnings back to AWS service teams, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron. Identify opportunities to expand model customization and optimization within your customer engagement. About the team The Custom Model and Optimization team, part of the Forward Deployed Engineering team partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference workloads onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers' most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS. ABOUT AWS: Diverse Experiences Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.
About the team The Custom Model and Optimization team, part of the Forward Deployed Engineering team partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference workloads onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers' most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS. ABOUT AWS: Diverse Experiences Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying. Why AWS Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses. Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud.
Work/Life Balance We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. Inclusive Team Culture AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do. Mentorship and Career Growth We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.
- 3+ years of non-internship professional software development experience - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language - Hands-on experience with generative AI technology, such as LLMs, vision-language models, or speech models Preferred qualifications - Bachelor's degree in computer science or equivalent - Experience with large-scale distributed training of LLMs on multi-node accelerator clusters, using frameworks such as PyTorch FSDP2, TorchTitan, Megatron-LM/Megatron Core, NeMo, DeepSpeed, or NeuronX Distributed - Experience with LLM post-training, including SFT, DPO, RLHF, and RL with verifiable rewards or multi-turn agentic RL, using frameworks such as Miles, slime, verl, NeMo-RL, OpenRLHF, SkyRL, or TRL - Experience optimizing model training or inference for latency, throughput, or cost, using serving engines such as SGLang, vLLM, or TensorRT-LLM, on AWS Trainium or Inferentia (Neuron SDK), on AWS services such as SageMaker AI, SageMaker HyperPod, or EKS, or by writing custom kernels (CUDA, Triton, NKI) - Experience deploying and operating ML models in customer production environments, working with teams that build and scale end-to-end production systems Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Customize and post-train models. Adapt open-weight and foundation models to customer domains through continued pre-training, supervised fine-tuning, preference optimization, and reinforcement learning (including RLHF, RL with verifiable rewards, and multi-turn agentic RL). Build the data pipelines, synthetic data generation, and evaluation harnesses that prove a customized model out performs the baseline on the customer's own quality, latency, and cost bar. Apply these techniques to high-value patterns such as coding agents, domain foundation models, and multi-adapter serving. Build large-scale training and inference systems. Design and implement distributed training and RL post-training pipelines using frameworks such as PyTorch FSDP2, Megatron-LM, Miles, and verl. Build RL interaction harnesses using NeMo Gym or OpenEnv to connect agent workflows, tools, environments, and reward functions to training. Develop production inference stacks with engines such as SGLang and vLLM, and optimize throughput, latency, memory footprint, and cost per token through quantization, parallelism, speculative decoding, and batching. Optimize models on AWS chips. Migrate and tune training and inference workloads for AWS Trainium using the AWS Neuron SDK. Profile performance, close accuracy-parity gaps against GPU baselines, and develop custom kernels where needed. Benchmark rigorously and turn results into decisions customers can act on.

Your next step

Complete your application on www.amazon.jobs. The employer’s form will show what is required.

Already applied? Track this application

Has Amazon posted this job before?

Yes. We’ve followed 2 other Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering jobs there since November 2026. All 2 are still up.

  1. LondonStill up after 5 days, first seen Nov 13
  2. SeattleStill up after 5 days, first seen Nov 13
  3. This jobUp 5 days so far, first seen Nov 13

Job description

View original posting ↗

As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with strategic customers to build, optimize, and run custom generative AI models in production alongside their engineering teams. You own complete model workstreams end-to-end from defining the evaluation bar and preparing data, through training and inference optimization, to production deployment.

FDE IIs on this team works at the intersection of models and systems. They customize state-of-the-art open-weight and foundation models for new domains, languages, and modalities; migrate and optimize training and inference workloads on AWS Trainium and operate those models as production services. They are autonomous contributors who take on projects where the business goal is clear, but the path is not. They make design trade-offs with appropriate guidance, limit short-term workarounds, coach others on producing high-quality code, and train new team members.

Key job responsibilities
Embed within customer ML and engineering teams: Understand the customer's business, data, model stack, and operational constraints. Translate ambiguous goals into a measurable evaluation bar and a technical plan for your workstream such as model selection, customization approach, and serving architecture. Requires up to 25% travel.

Customize and post-train models. Adapt open-weight and foundation models to customer domains through continued pre-training, supervised fine-tuning, preference optimization, and reinforcement learning (including RLHF, RL with verifiable rewards, and multi-turn agentic RL). Build the data pipelines, synthetic data generation, and evaluation harnesses that prove a customized model out performs the baseline on the customer's own quality, latency, and cost bar. Apply these techniques to high-value patterns such as coding agents, domain foundation models, and multi-adapter serving.

Build large-scale training and inference systems. Design and implement distributed training and RL post-training pipelines using frameworks such as PyTorch FSDP2, Megatron-LM, Miles, and verl. Build RL interaction harnesses using NeMo Gym or OpenEnv to connect agent workflows, tools, environments, and reward functions to training. Develop production inference stacks with engines such as SGLang and vLLM, and optimize throughput, latency, memory footprint, and cost per token through quantization, parallelism, speculative decoding, and batching.

Optimize models on AWS chips. Migrate and tune training and inference workloads for AWS Trainium using the AWS Neuron SDK. Profile performance, close accuracy-parity gaps against GPU baselines, and develop custom kernels where needed. Benchmark rigorously and turn results into decisions customers can act on.

Accelerate impact beyond the engagement. Codify reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and optimization patterns that accelerate future deployments. Feed field learnings back to AWS service teams, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron. Identify opportunities to expand model customization and optimization within your customer engagement.


About the team
The Custom Model and Optimization team, part of the Forward Deployed Engineering team partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference workloads onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers' most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS.

ABOUT AWS:
 
Diverse Experiences
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
 
Why AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. 

Inclusive Team Culture
AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do.

Mentorship and Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. 

10047

Basic qualifications

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- Hands-on experience with generative AI technology, such as LLMs, vision-language models, or speech models

Preferred qualifications

- Bachelor's degree in computer science or equivalent
- Experience with large-scale distributed training of LLMs on multi-node accelerator clusters, using frameworks such as PyTorch FSDP2, TorchTitan, Megatron-LM/Megatron Core, NeMo, DeepSpeed, or NeuronX Distributed
- Experience with LLM post-training, including SFT, DPO, RLHF, and RL with verifiable rewards or multi-turn agentic RL, using frameworks such as Miles, slime, verl, NeMo-RL, OpenRLHF, SkyRL, or TRL
- Experience optimizing model training or inference for latency, throughput, or cost, using serving engines such as SGLang, vLLM, or TensorRT-LLM, on AWS Trainium or Inferentia (Neuron SDK), on AWS services such as SageMaker AI, SageMaker HyperPod, or EKS, or by writing custom kernels (CUDA, Triton, NKI)
- Experience deploying and operating ML models in customer production environments, working with teams that build and scale end-to-end production systems

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.



USA, CA, East Palo Alto - 165,200.00 - 223,600.00 USD annually
USA, MA, Boston - 143,700.00 - 194,400.00 USD annually
USA, NY, New York - 158,100.00 - 213,800.00 USD annually
USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually

About Amazon

People
About 1,207,759 in 2024.Benefit plan filings (Form 5500)
Company
Listed as AMZN.
H-1B visas
6,217 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Layoff notices
Notices this year and last cover 2,978 people. The latest was filed November 2, 2026.State WARN notices

About the role

We file this job under Forward Deployed Engineer, by the work the posting describes.

Forward deployed engineers are placed with their employer's customers: they learn a customer's problem and write the code that makes the employer's product solve it inside the customer's own systems.

Postings ask for strong software engineering, most often in Python, ease with customers and their executives, often travel, and in about three of four cases work with large language models or AI agents.

An AI engineer or data engineer builds for their own employer's product team; a forward deployed engineer does similar work inside a customer. We give this role to every posting whose title says forward deployed.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits. USA, CA, East Palo Alto - 165,200.00 - 223,600.00 USD annually USA, MA, Boston - 143,700.00 - 194,400.00 USD annually USA, NY, New York - 158,100.00 - 213,800.00 USD annually USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
Location & working pattern

Arlington, Virginia, USA

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.