Back to jobs

Forward Deployed Engineer - AI Inference

San Francisco · San Francisco, California, United States

Actively hiring, first seen by us 3 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
Location type: Hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering › Forward Deployed Engineer — team source
Department: Engineering › Forward Deployed Engineer
From the employer’s posting

What you’ll work on

Full posting
  • Design and implement large-scale deployment architectures for LLM and multimodal inference

  • Deploy and manage containerized workloads across Kubernetes clusters

  • Diagnose production issues like performance bottlenecks and apply temporary fixes

  • Integrate FriendliAI infrastructure into customers' CI/CD workflows with their DevOps teams

  • Build scripts, Helm charts, and Terraform modules for repeated deployments

From the employer’s posting
Design and implement large-scale deployment architectures for LLM and multimodal inference
Deploy and manage containerized workloads across Kubernetes clusters
Diagnose production issues, such as performance bottlenecks, and implement temporary fixes as needed
Collaborate with customers’ DevOps teams to integrate FriendliAI’s infrastructure into their CI/CD workflows
Develop scripts, Helm charts, and Terraform modules that simplify repeated deployments

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or in the near future require visa sponsorship?
From the employer’s application form

What you’ll bring

All qualifications

Core experience

  • 3+ years of experience in cloud infrastructure, DevOps, or reliability engineering
  • Experience operating workloads on AWS, GCP, or OCI
  • Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
  • Proficiency with Kubernetes, Docker, Terraform, and Helm
  • Experience with GPU-based computing and generative AI model serving workloads

Preferred experience

  • Experience deploying large models (LLMs, diffusion models) on GPUs or clusters
  • Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference)
  • Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL)
  • Understanding of networking security and compliance frameworks (e.g., SOC 2)
Qualification wording
3+ years of experience in cloud infrastructure, DevOps, or reliability engineering
Experience operating workloads on AWS, GCP, or OCI
Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
Proficiency with Kubernetes, Docker, Terraform, and Helm
Experience with GPU-based computing and generative AI model serving workloads
Experience deploying large models (LLMs, diffusion models) on GPUs or clusters
Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference)
Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL)
Understanding of networking security and compliance frameworks (e.g., SOC 2)
Education & alternatives
- 3+ years of experience in cloud infrastructure, DevOps, or reliability engineering - Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent - Proficiency with Kubernetes, Docker, Terraform, and Helm

Benefits in the posting

Full benefits wording
  • A front-row seat to the generative AI infrastructure revolution
  • Competitive compensation and benefits package
  • Health check-up and top-tier hardware support

From the employer’s posting.

About FriendliAI

FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models in production at scale.

In the employer’s words · Read in context · Company website ↗

Apply at FriendliAI

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026
Employer says posted
Oct 7, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Similar jobs usually come down between day 3 and day 42.

From 633 similar postings that came down. Coming down is not always a hire.

FriendliAI is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • AWS
  • Docker
  • GCP
  • Grafana
  • Kubernetes
  • Terraform
Where the posting names them
FriendliAI is seeking a Forward Deployed Engineer to assist enterprises in deploying, scaling, and operating generative and agentic AI workloads on FriendliAI infrastructure. You will work directly with customers to solve and implement production-grade applications using our products, such as Serverless Endpoints, Dedicated Endpoints, or Container. Friendli Container is our service that allows customers to download our inference engine as Docker images and deploy it in their chosen environment, such as private clouds or on-premises. Our Friendli Container can be adopted directly to AWS EKS clusters using our EKS add-on product. You will work directly on our customers’ projects, collaborating with their engineering teams to solve AI inference challenges like scaling, orchestration, and monitoring. This is a hands-on, customer-embedded role. If you have worked in DevOps, platform engineering, or SRE for AI applications, this is your ideal position.
- Strong technical background in backend systems or AI tooling - Experience operating workloads on AWS, GCP, or OCI - Excellent problem-solving and debugging skills in real-world environments
- Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent - Proficiency with Kubernetes, Docker, Terraform, and Helm - Strong foundation in distributed systems, networking, and performance tuning
- Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference) - Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL) - Understanding of networking security and compliance frameworks (e.g., SOC 2)
- Design and implement large-scale deployment architectures for LLM and multimodal inference - Deploy and manage containerized workloads across Kubernetes clusters - Diagnose production issues, such as performance bottlenecks, and implement temporary fixes as needed
- Collaborate with customers’ DevOps teams to integrate FriendliAI’s infrastructure into their CI/CD workflows - Develop scripts, Helm charts, and Terraform modules that simplify repeated deployments - Contribute field insights to shape our platform reliability, observability, and scaling strategies

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About the job

FriendliAI is seeking a Forward Deployed Engineer to assist enterprises in deploying, scaling, and operating generative and agentic AI workloads on FriendliAI infrastructure. You will work directly with customers to solve and implement production-grade applications using our products, such as Serverless Endpoints, Dedicated Endpoints, or Container.

Friendli Container is our service that allows customers to download our inference engine as Docker images and deploy it in their chosen environment, such as private clouds or on-premises. Our Friendli Container can be adopted directly to AWS EKS clusters using our EKS add-on product.

You will work directly on our customers’ projects, collaborating with their engineering teams to solve AI inference challenges like scaling, orchestration, and monitoring. This is a hands-on, customer-embedded role. If you have worked in DevOps, platform engineering, or SRE for AI applications, this is your ideal position.

Key Responsibilities

  • Design and implement large-scale deployment architectures for LLM and multimodal inference

  • Deploy and manage containerized workloads across Kubernetes clusters

  • Diagnose production issues, such as performance bottlenecks, and implement temporary fixes as needed

  • Collaborate with customers’ DevOps teams to integrate FriendliAI’s infrastructure into their CI/CD workflows

  • Develop scripts, Helm charts, and Terraform modules that simplify repeated deployments

  • Contribute field insights to shape our platform reliability, observability, and scaling strategies

  • Lead workshops, technical sessions, or webinars to help customers master infrastructure best practices.

Qualifications

  • 3+ years of experience in cloud infrastructure, DevOps, or reliability engineering

  • Bachelor’s or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent

  • Proficiency with Kubernetes, Docker, Terraform, and Helm

  • Strong foundation in distributed systems, networking, and performance tuning

  • Experience with GPU-based computing and generative AI model serving workloads

  • Strong technical background in backend systems or AI tooling

  • Experience operating workloads on AWS, GCP, or OCI

  • Excellent problem-solving and debugging skills in real-world environments

Preferred Experience

  • Experience deploying large models (LLMs, diffusion models) on GPUs or clusters

  • Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference)

  • Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL)

  • Understanding of networking security and compliance frameworks (e.g., SOC 2)

  • Experience supporting on-prem or hybrid-cloud deployments

Benefits

  • A front-row seat to the generative AI infrastructure revolution

  • Competitive compensation and benefits package

  • Daily lunch and dinner provided; unlimited snacks and beverages

  • Health check-up and top-tier hardware support

  • Flexible working hours and a highly collaborative environment

About us

FriendliAI is the fastest inference cloud for agents, built to run frontier open-weight models in production at scale. It delivers up to 7x faster output token speed, up to 90% lower inference costs, and 99.99% uptime across the most demanding agent workloads — long-context inference, real-time streaming, and accurate tool calling.

We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology. With our world-class inference stack, we are building the platform teams can actually rely on.

Demand for Forward Deployed Engineer roles

New Forward Deployed Engineer postings at the employers we follow are up 225% over the last 6 weeks compared with the 6 before.

Weekly new Forward Deployed Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 51, the most 267, and the latest week had 217.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Forward Deployed Engineer, by the work the posting describes.

Forward deployed engineers are placed with their employer's customers: they learn a customer's problem and write the code that makes the employer's product solve it inside the customer's own systems.

Postings ask for strong software engineering, most often in Python, ease with customers and their executives, often travel, and in about three of four cases work with large language models or AI agents.

An AI engineer or data engineer builds for their own employer's product team; a forward deployed engineer does similar work inside a customer. We give this role to every posting whose title says forward deployed.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

San Francisco, California, United States

- Understanding of networking security and compliance frameworks (e.g., SOC 2) - Experience supporting on-prem or hybrid-cloud deployments Benefits
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.