Back to jobs

Forward Deployed Engineer New Grad

San Mateo · San Mateo, California, United States

Live, first seen by us 40 days ago
Pay
Pay not listed
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Sales — team source

What you’ll work on

Full posting
  • Own the technical relationship with customers from evaluation through production.

  • Analyze inference performance including latency, throughput, concurrency, caching, and reliability.

  • Build customer-specific integrations, prototypes, tools, and automation.

From the employer’s posting
What You’ll Do Own the technical relationship with customers from evaluation through production. Understand customer architectures, workloads, and engineering requirements.
Debug issues across APIs, containers, Linux, networking, model serving, and distributed systems. Analyze inference performance including latency, throughput, concurrency, caching, and reliability. Build customer-specific integrations, prototypes, tools, and automation.
Analyze inference performance including latency, throughput, concurrency, caching, and reliability. Build customer-specific integrations, prototypes, tools, and automation. Support PoCs and help customers transition into production.

Before you apply

New graduates
Open to new graduatesJob title: Forward Deployed Engineer New Grad
Sponsorship
Visa sponsorship not confirmed — sponsorship source
Will you now or will you in the future require employment visa sponsorship to work in the country in which the job you're applying for is located?
From the employer’s application form

What you’ll bring

All qualifications

Core experience

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
  • Experience with LLMs, AI agents, or inference infrastructure.
  • Proficiency in Python and experience with at least one additional programming language.
  • Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.
  • Strong understanding of APIs, Linux, networking, and cloud-native applications.
  • Experience with Docker and Kubernetes.
Qualification wording
Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.
Experience with LLMs, AI agents, or inference infrastructure.
Proficiency in Python and experience with at least one additional programming language.
Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.
Strong understanding of APIs, Linux, networking, and cloud-native applications.
Experience with Docker and Kubernetes.
Education & alternatives
Requirements - Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field. - Strong software engineering fundamentals.

About Novita AI

We provide high-performance Model APIs, dedicated inference infrastructure, and Agent Sandbox environments that help developers and enterprises build, deploy, and scale production AI applications.

In the employer’s words · Read in context · Company website ↗

Apply at Novita AI

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 13, 202640 days ago
Recorded sightings
16
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 40

Similar jobs usually come down between day 3 and day 42.

From 633 similar postings that came down. Coming down is not always a hire.

Novita AI is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Docker
  • Kubernetes
Where the posting names them
- Strong software engineering fundamentals. - Proficiency in Python and experience with at least one additional programming language. - Strong understanding of APIs, Linux, networking, and cloud-native applications.
- Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks. - Experience with Docker and Kubernetes. - Understanding of model serving performance, including batching, caching, throughput, latency, and concurrency.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Novita AI

Novita AI is an AI & Agent Cloud platform for builders.

We provide high-performance Model APIs, dedicated inference infrastructure, and Agent Sandbox environments that help developers and enterprises build, deploy, and scale production AI applications.

The Role

As a Forward Deployed Engineer, you’ll work directly with customers building some of the most demanding AI applications.

You’ll operate at the intersection of software engineering, infrastructure, product, and customer success.

You may spend one day helping an AI startup diagnose inference latency, another helping a coding-agent company scale thousands of sandbox environments, and another building an integration that becomes a reusable product capability.

You will be expected not only to solve technical problems, but also to understand why those problems matter to the customer and what is required for their workload to successfully reach production.

What You’ll Do

  • Own the technical relationship with customers from evaluation through production.

  • Understand customer architectures, workloads, and engineering requirements.

  • Deploy and integrate:

    • Model APIs and inference endpoints

    • Dedicated model serving

    • Agent Sandbox environments

  • Debug issues across APIs, containers, Linux, networking, model serving, and distributed systems.

  • Analyze inference performance including latency, throughput, concurrency, caching, and reliability.

  • Build customer-specific integrations, prototypes, tools, and automation.

  • Support PoCs and help customers transition into production.

  • Work closely with Technical Account Executives on capacity planning, quotas, pricing considerations, and workload expansion.

  • Identify opportunities where customers can expand their usage of Novita.

  • Translate recurring customer problems into product requirements.

  • Build reusable tooling and reference implementations that improve the experience for future customers.

  • Work closely with engineering teams across the US and Asia.

What We’re Looking For

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field.

  • Strong software engineering fundamentals.

  • Proficiency in Python and experience with at least one additional programming language.

  • Strong understanding of APIs, Linux, networking, and cloud-native applications.

  • Experience debugging complex technical systems.

  • Strong written and verbal communication skills.

  • Comfortable working directly with customers.

  • High ownership and ability to operate in ambiguous environments.

  • Ability to move quickly between engineering, product, and customer problems.

Nice to Have

  • Experience with LLMs, AI agents, or inference infrastructure.

  • Familiarity with vLLM, SGLang, Ray, or distributed serving frameworks.

  • Experience with Docker and Kubernetes.

  • Understanding of model serving performance, including batching, caching, throughput, latency, and concurrency.

  • Experience building coding agents, AI agents, or sandboxed execution systems.

  • Open-source contributions, startup experience, or significant technical side projects.

  • Background in solutions engineering, developer relations, technical consulting, or other customer-facing technical roles.

  • Interest in the commercial side of technology, including how usage, pricing, and product adoption connect.

  • Professional working proficiency in Mandarin Chinese.

What Success Looks Like

Within your first year, you will:

  • Independently own the technical relationship with multiple customers.

  • Help strategic customers successfully move workloads into production.

  • Become a trusted technical advisor to customer engineering teams.

  • Build reusable solutions that accelerate future deployments.

  • Identify technical and product opportunities that increase customer adoption.

  • Influence Novita’s product roadmap through direct exposure to real production workloads.

Demand for Forward Deployed Engineer roles

New Forward Deployed Engineer postings at the employers we follow are up 225% over the last 6 weeks compared with the 6 before.

Weekly new Forward Deployed Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 51, the most 267, and the latest week had 217.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Forward Deployed Engineer, by the work the posting describes.

Forward deployed engineers are placed with their employer's customers: they learn a customer's problem and write the code that makes the employer's product solve it inside the customer's own systems.

Postings ask for strong software engineering, most often in Python, ease with customers and their executives, often travel, and in about three of four cases work with large language models or AI agents.

An AI engineer or data engineer builds for their own employer's product team; a forward deployed engineer does similar work inside a customer. We give this role to every posting whose title says forward deployed.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

San Mateo, California, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.