Back to jobs

ML Infrastructure and Performance Engineer, AI Expert (Remote)

Pay
$90–120/hour — pay source
This role is for one of our clients Compensation: $90 - $120 per hour Location: Remote
Read the full posting
Work setting
Remote — work setting source
Compensation: $90 - $120 per hour Location: Remote Job Overview
In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems. This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements. Requirements
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Design technical tasks on kernel development, profiling, distributed debugging and inference serving

  • Write complex engineering problems and reference solutions that test advanced AI models

  • Evaluate AI-generated solutions for correctness, efficiency, scalability and practicality

  • Write technical guidelines and assessment rubrics for kernels, profilers and inference

  • Analyze performance bottlenecks across compilers, accelerators and model-serving systems

From the employer’s posting
Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving.
Develop complex and adversarial engineering problems that test the capabilities of advanced AI models
Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance.
Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.

What you’ll bring

All qualifications

Core experience

  • Practical experience in at least one of the following areas:
  • Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.

Preferred experience

  • Experience with JAX, XLA, and TPU-based development environments.
  • Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
  • Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
  • Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
Qualification wording
Practical experience in at least one of the following areas:
Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
Experience with JAX, XLA, and TPU-based development environments.
Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
Apply at Weekday AI

Posting record

Report an error

Actively hiringFirst seen by us 9 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 12, 20269 days ago
Recorded sightings
10
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 9

Similar jobs usually come down between day 7 and day 76.

Well past Weekday AI’s usual: its jobs come down by about day 4.

From 6,389 similar postings that came down, and 125 of Weekday AI’s. Coming down is not always a hire.

Weekday AI is hiring

52 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Takes jobs down at a usual pace
  • 8% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • AWS
  • PyTorch
Where the posting names them
- Production-level experience with JAX and/or PyTorch. - Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300. - Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
- LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching. - Production-level experience with JAX and/or PyTorch. - Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.

Your next step

Complete your application on apply.workable.com. The employer’s form will show what is required.

Applying through Workable

  • No account needed. You can import your resume to fill in the form, or skip that and fill it in yourself.

Already applied? Track this application

Job description

View original posting ↗

This role is for one of our clients

Compensation: $90 - $120 per hour

Location: Remote

Job Overview

We are seeking an experienced ML Infrastructure and Performance Engineer to contribute to the development and advancement of next-generation Generative AI systems. This role is focused on building, optimizing, debugging, and evaluating the infrastructure that powers large language models and other frontier AI systems.

The ideal candidate will have hands-on experience in ML systems engineering, accelerator performance optimization, distributed workloads, or large-scale model serving. Expertise in areas such as custom accelerator kernels, performance profiling, trace analysis, distributed systems debugging, and high-throughput inference is particularly valuable. Experience with JAX, XLA, and TPU-based infrastructure will be a strong advantage.

In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems.

This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements.

Requirements

Key Responsibilities

  • Design challenging technical tasks covering accelerator kernel development, performance profiling, distributed workload debugging, and high-throughput inference serving.
  • Develop complex and adversarial engineering problems that test the capabilities of advanced AI models, including tasks involving accelerator programming and optimization.
  • Create accurate, technically sound reference solutions that demonstrate best practices in ML systems engineering.
  • Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
  • Develop detailed technical guidelines and assessment rubrics for kernel optimization, profiler interpretation, distributed systems, and inference performance.
  • Analyze performance bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.
  • Provide clear, structured technical feedback to help improve AI model capabilities in ML systems and infrastructure engineering.
  • Collaborate with researchers and fellow subject matter experts to maintain the quality, consistency, and accuracy of AI training and evaluation data.

Required Qualifications

  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a closely related field.
  • Practical experience in at least one of the following areas:
    • Accelerator Kernel Programming: Developing or optimizing custom kernels using Pallas, Triton, CUDA, CUTLASS, or similar technologies.
    • Performance Profiling: Working with profiling and trace-analysis tools such as JAX/XLA Profiler, Kineto, torch.profiler, or NVIDIA Nsight.
    • Distributed Workload Debugging: Identifying and resolving performance and execution issues in distributed or accelerator-intensive workloads.
    • LLM Inference Serving: Experience with vLLM, SGLang, TensorRT-LLM, JetStream, KV cache optimization, paged attention, or continuous batching.
  • Production-level experience with JAX and/or PyTorch.
  • Understanding of modern accelerator architectures, including TPUs (v4–v6e), NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
  • Demonstrable professional growth and career progression in engineering or infrastructure-focused roles.
  • Availability to commit at least 40 hours per week on weekdays.
  • Excellent written communication skills, with the ability to explain complex technical concepts and engineering decisions clearly.

Preferred Qualifications

  • Experience with JAX, XLA, and TPU-based development environments.
  • Knowledge of custom operators, sharding, and distributed training frameworks such as pjit, shard_map, FSDP, Megatron, or MaxText.
  • Familiarity with compiler and graph-level technologies such as XLA, StableHLO, torch.compile, and MLIR.
  • Experience developing performance benchmarks, technical evaluation frameworks, or engineering assessment rubrics.
  • Exposure to AI model evaluation, synthetic training data generation, or working with frontier AI systems.

Engagement Details

  • Work Arrangement: Fully Remote
  • Geographic Eligibility: Worldwide
  • Commitment: Full-Time, 40 hours per week
  • Schedule: Weekdays
  • Engagement Structure: Employment or engagement through an appropriate local partner, depending on the candidate's country of residence.
  • Availability: Candidates must be able to commit exclusively to this engagement without conflicting professional commitments.

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
This role is for one of our clients Compensation: $90 - $120 per hour Location: Remote
Location & working pattern

United States

Compensation: $90 - $120 per hour Location: Remote Job Overview
More source context
In this role, you will apply your engineering expertise to create, evaluate, and improve technical tasks and solutions used to train and assess advanced AI models. Your work will help improve how frontier AI systems understand and solve complex ML infrastructure and performance engineering problems. This is a fully remote opportunity open to candidates worldwide. The engagement will be structured in accordance with applicable local employment and compliance requirements. Candidates must be available for a full-time commitment of 40 hours per week, with no conflicting professional engagements. Requirements

More relevant text appears in the full description.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.