Back to jobs

AI Software Engineer

Seattle · Seattle, Washington, United States

Live, first seen by us 34 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
Company: ElastixAI, Inc. Location: Seattle, WA (Hybrid - 3 days/week in office) About ElastixAI
Location type: Hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Engineering — team source
Department: Engineering
From the employer’s posting

What you’ll work on

Full posting

We’re looking for a systems-minded AI Software Engineer to join our core inference platform team.

  • Develop efficient model partitioning, scheduling, and memory management strategies for multi-device inference.

  • Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms).

  • Work closely with hardware engineers to influence accelerator interface design and performance tuning.

From the employer’s posting
We’re looking for a systems-minded AI Software Engineer to join our core inference platform team. You’ll design and extend the low-level serving stack — hacking open-source frameworks like vLLM, SGLang, and TensorRT-LLM, building new model sharding and scheduling logic, and integrating deeply with our proprietary AI accelerator. This role sits at the intersection of ML systems, compiler/runtime engineering, and hardware-software co-design.
Customize open-source serving frameworks (e.g., vLLM) for proprietary model ingestion and accelerator integration. Develop efficient model partitioning, scheduling, and memory management strategies for multi-device inference. Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms).
Develop efficient model partitioning, scheduling, and memory management strategies for multi-device inference. Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms). Work closely with hardware engineers to influence accelerator interface design and performance tuning.
Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms). Work closely with hardware engineers to influence accelerator interface design and performance tuning. Build APIs and runtime tools enabling flexible, PyTorch-native model deployment on our infrastructure.

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Do you now or will you in the future require visa sponsorship to work in the United States?
From the employer’s application form

What you’ll bring

All qualifications

Core experience

  • 3+ years of professional experience in systems programming, ML infrastructure, or distributed inference.
  • Experience with hardware-aware ML optimization, compiler/runtime integration, or accelerator SDKs.
  • Proficient in C++ and Python, with strong debugging and performance analysis skills.
  • Hands-on experience profiling GPU/accelerator workloads.
  • Deep familiarity with one or more LLM serving frameworks (vLLM, SGLang, TensorRT-LLM, DeepSpeed-Inference, etc.).
  • Familiarity with containerized deployments (Docker/Kubernetes).
Qualification wording
3+ years of professional experience in systems programming, ML infrastructure, or distributed inference.
Experience with hardware-aware ML optimization, compiler/runtime integration, or accelerator SDKs.
Proficient in C++ and Python, with strong debugging and performance analysis skills.
Hands-on experience profiling GPU/accelerator workloads.
Deep familiarity with one or more LLM serving frameworks (vLLM, SGLang, TensorRT-LLM, DeepSpeed-Inference, etc.).
Familiarity with containerized deployments (Docker/Kubernetes).
Education & alternatives
Required Qualifications - BS/MS/PhD in Computer Science, Electrical/Computer Engineering, or related field. - 3+ years of professional experience in systems programming, ML infrastructure, or distributed inference.

Benefits in the posting

Full benefits wording
  • A chance to be a foundational engineer in an innovative AI startup
  • Competitive compensation and startup equity package
  • Comprehensive medical, dental, and vision coverage (100% paid by employer)
  • Life insurance and AD&D
  • 12-paid holidays
  • Paid parental leave
  • Gym or fitness benefit
  • Commuter benefit
  • Weekly catered lunches in the office
  • Investment in employee learning & development

From the employer’s posting.

About ElastixAI

We are building the next-gen AI inference platform.

In the employer’s words · Read in context · Company website ↗

Apply at ElastixAI

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 18, 202634 days ago
Recorded sightings
40
Last seen by us
Nov 22, 2026
Employer says posted
Feb 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 34

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,376 similar postings that came down. Coming down is not always a hire.

ElastixAI is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C++
  • Python
  • Docker
  • Kubernetes
  • PyTorch
Where the posting names them
- Build APIs and runtime tools enabling flexible, PyTorch-native model deployment on our infrastructure. - Profile, debug, and optimize across the full stack — from Python orchestration to C++ kernels and PCIe drivers. Required Qualifications
- 3+ years of professional experience in systems programming, ML infrastructure, or distributed inference. - Proficient in C++ and Python, with strong debugging and performance analysis skills. - Deep familiarity with one or more LLM serving frameworks (vLLM, SGLang, TensorRT-LLM, DeepSpeed-Inference, etc.).
- Hands-on experience profiling GPU/accelerator workloads. - Familiarity with containerized deployments (Docker/Kubernetes). - Exposure to distributed systems or large-scale inference clusters.
- Work closely with hardware engineers to influence accelerator interface design and performance tuning. - Build APIs and runtime tools enabling flexible, PyTorch-native model deployment on our infrastructure. - Profile, debug, and optimize across the full stack — from Python orchestration to C++ kernels and PCIe drivers.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Elastix AI

We are building the next-gen AI inference platform.

Description

Job Title: Software Engineer, AI Inference Platform

Company: ElastixAI, Inc.

Location: Seattle, WA (Hybrid - 3 days/week in office)

About ElastixAI

ElastixAI is an early-stage startup building the next-generation AI inference infrastructure — co-designed across ML software and custom accelerator hardware. Our platform dynamically optimizes inference efficiency and scalability across diverse deployments, enabling adaptive, high-performance AI serving.

Role Summary

We’re looking for a systems-minded AI Software Engineer to join our core inference platform team. You’ll design and extend the low-level serving stack — hacking open-source frameworks like vLLM, SGLang, and TensorRT-LLM, building new model sharding and scheduling logic, and integrating deeply with our proprietary AI accelerator. This role sits at the intersection of ML systems, compiler/runtime engineering, and hardware-software co-design.

Key Responsibilities

  • Architect, extend, and optimize core components of our AI serving platform for throughput, latency, and scalability.

  • Customize open-source serving frameworks (e.g., vLLM) for proprietary model ingestion and accelerator integration.

  • Develop efficient model partitioning, scheduling, and memory management strategies for multi-device inference.

  • Collaborate with ML engineers on model export and runtime optimization (quantization, graph transforms).

  • Work closely with hardware engineers to influence accelerator interface design and performance tuning.

  • Build APIs and runtime tools enabling flexible, PyTorch-native model deployment on our infrastructure.

  • Profile, debug, and optimize across the full stack — from Python orchestration to C++ kernels and PCIe drivers.

Required Qualifications

  • BS/MS/PhD in Computer Science, Electrical/Computer Engineering, or related field.

  • 3+ years of professional experience in systems programming, ML infrastructure, or distributed inference.

  • Proficient in C++ and Python, with strong debugging and performance analysis skills.

  • Deep familiarity with one or more LLM serving frameworks (vLLM, SGLang, TensorRT-LLM, DeepSpeed-Inference, etc.).

  • Understanding of model deployment internals — token scheduling, KV caching, batching, and pipelined inference.

  • Comfortable working close to the hardware abstraction layer — CUDA, PCIe, memory management, or runtime scheduling.

  • Strong collaboration and communication skills; ability to work cross-functionally in a fast-paced startup environment.

Preferred / Bonus

  • Experience with hardware-aware ML optimization, compiler/runtime integration, or accelerator SDKs.

  • Hands-on experience profiling GPU/accelerator workloads.

  • Familiarity with containerized deployments (Docker/Kubernetes).

  • Exposure to distributed systems or large-scale inference clusters.

  • Contributions to open-source ML or serving frameworks.

What We Offer:

  • A chance to be a foundational engineer in an innovative AI startup

  • A dynamic and collaborative work environment and the change to have a significant impact on new technology

  • The opportunity to work on challenging problems at the intersection of ML, software, and systems.

  • Competitive compensation and startup equity package

  • Comprehensive medical, dental, and vision coverage (100% paid by employer)

  • Life insurance and AD&D

  • Flexible Time Off (FTO)

  • 12-paid holidays

  • Paid parental leave

  • Gym or fitness benefit

  • Commuter benefit

  • Weekly catered lunches in the office

  • Investment in employee learning & development

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Seattle, Washington, United States

Company: ElastixAI, Inc. Location: Seattle, WA (Hybrid - 3 days/week in office) About ElastixAI
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.