Back to jobs

AI Software Development Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Build vllm-sr into a universal serving engine for decision models that exposes the System One API and runs efficiently on everything from AMD Instinct GPUs to CPUs.

  • Optimize decision model inference across batching, memory, latency and throughput, down to GPU kernels in HIP or Triton on ROCm where it matters.

  • Build an auto research pipeline that keeps iterating on our decision models, automating experiments from data generation to training, evaluation and analysis.

From the employer’s posting
Make vllm-sr simple to deploy and operate in production, with first-class integrations for vLLM, Kubernetes, Envoy, Gateway API and AI gateways. Build vllm-sr into a universal serving engine for decision models that exposes the System One API and runs efficiently on everything from AMD Instinct GPUs to CPUs. Optimize decision model inference across batching, memory, latency and throughput, down to GPU kernels in HIP or Triton on ROCm where it matters.
Build vllm-sr into a universal serving engine for decision models that exposes the System One API and runs efficiently on everything from AMD Instinct GPUs to CPUs. Optimize decision model inference across batching, memory, latency and throughput, down to GPU kernels in HIP or Triton on ROCm where it matters. Train our foundation decision models across sizes and keep pushing their capabilities to the frontier, owning data, training, post-training and evaluation.
Train our foundation decision models across sizes and keep pushing their capabilities to the frontier, owning data, training, post-training and evaluation. Build an auto research pipeline that keeps iterating on our decision models, automating experiments from data generation to training, evaluation and analysis. Co-design the decision models with the serving engine, so that every new capability ships with the performance to serve it.

Before you apply

New graduates
Open to new graduatesFresh Graduates with strong programming skills in Python and at least one of Go, Rust or C++

What you’ll bring

All qualifications

Core experience

  • Hands-on experience with large language models: serving them (vLLM, SGLang or similar), training them, or building products on them.
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
  • Experience with model routing, API gateways or LLM inference optimization.
  • Experience training or post-training models such as classifiers, reward models or multimodal models.
Qualification wording
Hands-on experience with large language models: serving them (vLLM, SGLang or similar), training them, or building products on them.
Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience. Research experience in machine learning systems, distributed systems or high-performance computing is a plus.
Experience with model routing, API gateways or LLM inference optimization.
Experience training or post-training models such as classifiers, reward models or multimodal models.
Education & alternatives
ACADEMIC CREDENTIALS: - Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience. Research experience in machine learning systems, distributed systems or high-performance computing is a plus. LOCATION: Seoul, Korea

Posting record

Report an error

Actively hiringFirst seen by us 8 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 11, 20268 days ago
Recorded sightings
8
Last seen by us
Nov 18, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 8

Similar jobs usually come down between day 7 and day 75.

At Advanced Micro Devices, jobs usually come down by about day 33.

From 5,846 similar postings that came down, and 61 of Advanced Micro Devices’s. Coming down is not always a hire.

Advanced Micro Devices is hiring

44 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • ML Engineer hiring is steady
  • Takes jobs down at a usual pace
  • 2% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C++
  • Python
  • Rust
  • Kubernetes
  • Hugging Face
  • PyTorch
  • Go
Where the posting names them
Requirements: - Fresh Graduates with strong programming skills in Python and at least one of Go, Rust or C++. - Hands-on experience with large language models: serving them (vLLM, SGLang or similar), training them, or building products on them.
- Build the routing intelligence of vllm-sr, from decision models that pick the right model for every request to semantic, policy-based and workload-aware routing, semantic caching, and routing for safety, privacy, tools and agents. - Make vllm-sr simple to deploy and operate in production, with first-class integrations for vLLM, Kubernetes, Envoy, Gateway API and AI gateways. - Build vllm-sr into a universal serving engine for decision models that exposes the System One API and runs efficiently on everything from AMD Instinct GPUs to CPUs.
- Comfortable working in the open: GitHub workflows, public code review and clear written English. - Contributions to open-source projects such as vllm-sr, vLLM, SGLang, PyTorch, Hugging Face, Envoy or Kubernetes. - GPU programming experience (HIP, CUDA, Triton), or ROCm on AMD Instinct GPUs.

Your next step

Complete your application on global-external-amd.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Has Advanced Micro Devices posted this job before?

Yes. We’ve followed one other AI Software Development Engineer job there since November 2026. It is still up.

  1. This jobUp 8 days so far, first seen Nov 11
  2. TaipeiStill up after 2 days, first seen Nov 17

Job description

View original posting ↗



ADVANCE YOUR CAREER. ADVANCE THE WORLD. 

At AMD, we believe technology has the power to solve the world’s most important challenges. From advancing healthcare and scientific discovery to powering AI and the technologies people rely on every day, innovation at AMD is shaping the future. 

 

Whether you’re designing next-gen processors, enabling AI breakthroughs, or bringing leading edge products to market, every role at AMD contributes to something bigger — technology that moves the world forward. Join us and, together, we’ll advance your career.




THE ROLE:

AI applications no longer run on a single model. They combine frontier and open models, large and small, with agents and tools. Every request needs a decision: which model should answer, at what cost, and under which safety and privacy policies. We build the layer that makes that decision.

 

 

AMD is looking for a software engineer to join the core team behind vllm-sr. The team owns the whole stack: the router, the serving engine, the decision models and the open-source community. You will train and serve on AMD Instinct GPUs, help make ROCm a first-class platform for intelligent routing, and ship your work upstream as code, open models and papers that reach users around the world.

 

THE PERSON:

You are a hands-on engineer who wants to build software that people rely on. You have strong fundamentals in systems, machine learning, or both, and you understand how large language models are trained and served. AI is part of how you work every day, and you have taken products from idea to production with it. You measure before you optimize, and you write code that others are glad to review and maintain.

 

You are comfortable working in the open, where designs, code reviews and discussions happen on GitHub with a global community of contributors. The work spans systems, models and community, and we don't expect anyone to bring all of it on day one. We look for real depth in one area, such as routing and serving systems, inference performance or model training, and the curiosity to grow into the rest.

 

KEY RESPONSIBILITIES:

  • Build the routing intelligence of vllm-sr, from decision models that pick the right model for every request to semantic, policy-based and workload-aware routing, semantic caching, and routing for safety, privacy, tools and agents.
  • Make vllm-sr simple to deploy and operate in production, with first-class integrations for vLLM, Kubernetes, Envoy, Gateway API and AI gateways.
  • Build vllm-sr into a universal serving engine for decision models that exposes the System One API and runs efficiently on everything from AMD Instinct GPUs to CPUs.
  • Optimize decision model inference across batching, memory, latency and throughput, down to GPU kernels in HIP or Triton on ROCm where it matters.
  • Train our foundation decision models across sizes and keep pushing their capabilities to the frontier, owning data, training, post-training and evaluation.
  • Build an auto research pipeline that keeps iterating on our decision models, automating experiments from data generation to training, evaluation and analysis.
  • Co-design the decision models with the serving engine, so that every new capability ships with the performance to serve it.
  • Make decisions with data: build benchmarks and evaluations, profile end-to-end systems, and measure routing quality, latency and cost.
  • Ship production-quality software with strong testing, CI, observability and reliability.
  • Work upstream first: review and land community contributions, triage issues, ship releases and help the community grow.
  • Represent AMD and vllm-sr at conferences and workshops, and share the work through talks, demos, blogs and documentation that grow the community and show what vllm-sr can do on AMD GPUs.
  • Partner across AMD: with ROCm, kernel and AI framework teams to remove bottlenecks and validate vllm-sr on new AMD GPU platforms, and with Enterprise and IT teams to support AMD's internal products and IT services with vllm-sr.

 

Requirements:

  • Fresh Graduates with strong programming skills in Python and at least one of Go, Rust or C++.
  • Hands-on experience with large language models: serving them (vLLM, SGLang or similar), training them, or building products on them.
  • AI-native engineering: deep, daily use of AI coding agents and agentic workflows to design, build, test and ship, with the judgment to verify and correct their output.
  • Proven end-to-end delivery: products you built and shipped with AI driving the work, from idea and design through deployment and operations.
  • Solid fundamentals in systems, machine learning, or both.
  • Comfortable working in the open: GitHub workflows, public code review and clear written English.
  • Contributions to open-source projects such as vllm-sr, vLLM, SGLang, PyTorch, Hugging Face, Envoy or Kubernetes.
  • GPU programming experience (HIP, CUDA, Triton), or ROCm on AMD Instinct GPUs.
  • Experience with model routing, API gateways or LLM inference optimization.
  • Experience training or post-training models such as classifiers, reward models or multimodal models.
  • Papers at top machine learning or systems conferences.
    Technical writing, public speaking or community building.

 

ACADEMIC CREDENTIALS:

  • Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or equivalent experience.
    Research experience in machine learning systems, distributed systems or high-performance computing is a plus.

 

LOCATION:
Seoul, Korea




Benefits offered are described:  AMD benefits at a glance.

 

AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law.   We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.

 

AMD may use Artificial Intelligence to help screen, assess or select applicants for this position.  AMD’s “Responsible AI Policy” is available here.

 

This posting is for an existing vacancy.

About Advanced Micro Devices

People
About 31,000 in 2025, up 11% from the year before.Annual report (SEC Form 10-K)
Company
Listed as AMD.
H-1B visas
335 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Seoul, Korea, South

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.