Back to jobs

Software Engineer - ML Infrastructure

Pay
$130,000–185,000/yearAnnual period assumed. Plus bonus, equity — pay source
We offer a competitive compensation package designed to reward impact and incentivize growth. Our compensation philosophy is informed by our current valuation and recent industry data. Compensation: $130,000 - $185,000 plus performance-based bonus and meaningful equity package. Benefits:
Read the full posting
Work setting
Remote — work setting source
Listed location: Remote U.S. or Pittsburgh, PA
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: FullTime
From the employer’s posting

What you’ll work on

Full posting
  • Build and maintain infrastructure and deployment workflows for moving ML models to production

  • Develop internal tools that speed up model training, evaluation, and iteration

  • Design systems for evaluation pipelines, experiment orchestration, and monitoring

  • Support customer-specific and policy-driven technical requirements

From the employer’s posting
Build and maintain the infrastructure, services, and deployment workflows that enable ML models to move from experimentation into reliable production environments.
Develop internal tools and automation that improve the developer experience for model training, experimentation, evaluation, and iteration.
Design and optimize systems supporting model evaluation pipelines, experiment orchestration, reproducibility, and performance monitoring.
Support customer-specific technical requirements and policy-driven workflows, translating evolving needs into practical, scalable engineering solutions.

Before you apply

Work authorization
Sponsors visas

What you’ll bring

All qualifications

Core experience

  • Strong software engineering experience with production-grade systems or services
  • Experienced with Python
  • Familiarity with cloud infrastructure, distributed systems, containerization, or platform engineering
  • Knowledge of ML workflows such as training, inference, evaluation, or deployment
Qualification wording
A strong software engineer with experience building and maintaining production-grade systems, services, or infrastructure.
Experienced with Python and comfortable working across backend systems, APIs, and infrastructure code.
Familiar with cloud infrastructure, distributed systems, containerization, or platform engineering.
Knowledgeable about ML workflows, including model training, inference, evaluation, or deployment.

Benefits in the posting

Full benefits wording
  • 401k with up to 4% matching
  • 28 days annual leave (vacation + holidays)
  • Health, dental, and vision coverage
  • Flexible work arrangements
  • Visa sponsorship available for exceptional candidates
  • Interview Process

From the employer’s posting.

About gray%20swan%20ai

Gray Swan is on a mission to empower the world to use AI safely and securely.

In the employer’s words · Read in context

Apply at gray%20swan%20ai

Posting record

Report an error

Actively hiringFirst seen by us 9 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 10, 20269 days ago
Recorded sightings
10
Last seen by us
Nov 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Lower than most similar jobs

$130K–$185K against $166K–$237K, the middle half of what similar US postings state.

From 1,507 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 9

Similar jobs usually come down between day 7 and day 76.

From 5,848 similar postings that came down. Coming down is not always a hire.

gray%20swan%20ai is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Docker
  • GCP
  • Kubernetes
  • MLflow
Where the posting names them
- A strong software engineer with experience building and maintaining production-grade systems, services, or infrastructure. - Experienced with Python and comfortable working across backend systems, APIs, and infrastructure code. - Familiar with cloud infrastructure, distributed systems, containerization, or platform engineering.
- Experience building ML infrastructure, ML platforms, or internal developer tooling. - Familiarity with Kubernetes, Docker, and cloud platforms such as AWS or GCP. - Experience with ML infrastructure tools such as Ray, Kubeflow, MLflow, or Weights & Biases.
- Familiarity with Kubernetes, Docker, and cloud platforms such as AWS or GCP. - Experience with ML infrastructure tools such as Ray, Kubeflow, MLflow, or Weights & Biases. - Experience with model serving, distributed training, inference infrastructure, or large-scale evaluation pipelines.

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

About Gray Swan

Gray Swan is on a mission to empower the world to use AI safely and securely. We evaluate AI models for the leading frontier labs along with building real-time threat detection and adaptive adversarial red teaming agents for teams deploying AI.

We're a team of approximately 70 people, well-funded, growing quickly. Our work directly influences how the world deploys AI agents and systems at scale.

Learn more about how we work.

The Role

We’re looking for a Software Engineer, AI Infrastructure to work at the intersection of machine learning, software engineering, and production infrastructure. You’ll partner closely with our ML team to build the systems, tools, and workflows that help move models from experimentation into reliable production environments.

You’ll improve the developer experience around model training and evaluation, build scalable infrastructure to support ML workflows, and help translate customer requirements and policy considerations into practical technical solutions. This role is ideal for a strong software engineer who enjoys solving complex infrastructure challenges while working closely with ML researchers and engineers to accelerate development and deliver real-world impact.

What You’ll Do:

  • Build and maintain the infrastructure, services, and deployment workflows that enable ML models to move from experimentation into reliable production environments.

  • Develop internal tools and automation that improve the developer experience for model training, experimentation, evaluation, and iteration.

  • Design and optimize systems supporting model evaluation pipelines, experiment orchestration, reproducibility, and performance monitoring.

  • Partner with ML engineers and researchers to identify infrastructure bottlenecks and build solutions that accelerate model development and deployment.

  • Support customer-specific technical requirements and policy-driven workflows, translating evolving needs into practical, scalable engineering solutions.

  • Improve the reliability, scalability, and observability of the systems powering our ML capabilities.

Who You Are:

  • A strong software engineer with experience building and maintaining production-grade systems, services, or infrastructure.

  • Experienced with Python and comfortable working across backend systems, APIs, and infrastructure code.

  • Familiar with cloud infrastructure, distributed systems, containerization, or platform engineering.

  • Knowledgeable about ML workflows, including model training, inference, evaluation, or deployment.

  • Comfortable collaborating with ML engineers and researchers to translate complex technical requirements into reliable software.

  • An owner who can navigate ambiguity, identify problems independently, and deliver practical solutions in a fast-moving environment.

Bonus Points If You Have:

  • Experience building ML infrastructure, ML platforms, or internal developer tooling.

  • Familiarity with Kubernetes, Docker, and cloud platforms such as AWS or GCP.

  • Experience with ML infrastructure tools such as Ray, Kubeflow, MLflow, or Weights & Biases.

  • Experience with model serving, distributed training, inference infrastructure, or large-scale evaluation pipelines.

  • Exposure to AI safety, AI security, adversarial testing, or model behavior evaluation.

  • Experience translating customer requirements, security constraints, or policy considerations into technical implementations.

If you don’t have 100% of these, you should still seriously consider applying. We care more about what you can do than your credentials.

You’ll Thrive Here If You:

  • Enjoy working at the intersection of software engineering, infrastructure, and machine learning rather than staying within a single technical domain.

  • Are excited to build foundational systems and tooling that help other engineers move faster and work more effectively.

  • Take ownership of problems from initial investigation through implementation, deployment, and iteration.

  • Thrive in a fast-moving environment where priorities evolve and there isn't always an established playbook.

  • Communicate effectively across disciplines and enjoy partnering with researchers, engineers, and other stakeholders.

  • Care about building reliable, scalable systems that contribute to the safe and secure deployment of advanced AI.

What We Offer:

We offer a competitive compensation package designed to reward impact and incentivize growth. Our compensation philosophy is informed by our current valuation and recent industry data.

Compensation: $130,000 - $185,000 plus performance-based bonus and meaningful equity package.

Benefits:

  • 401k with up to 4% matching

  • 28 days annual leave (vacation + holidays)

  • Health, dental, and vision coverage

  • Catered lunches (Pittsburgh office)

  • Flexible work arrangements

  • Visa sponsorship available for exceptional candidates

Interview Process

🔎 Application review. We read everything; we’ll respond within 10 days.

🗣 Recruiter Screen. We learn about you; you learn about us.

🧑‍💻 Technical interview or Hiring Manager Interview.

💻 Role-related assessment.

🗣 Experience & culture interview.

😇 Reference checks. We’ll reach out to 3–5 references that you provide.

📃 Offer. If it’s mutual, we move fast.

How to Apply

Submit your resume, link to your portfolio, and answer the questions on the application.

 

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are up 12% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 556, the most 1,080, and the latest week had 556.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
We offer a competitive compensation package designed to reward impact and incentivize growth. Our compensation philosophy is informed by our current valuation and recent industry data. Compensation: $130,000 - $185,000 plus performance-based bonus and meaningful equity package. Benefits:
Location & working pattern

Remote U.S. or Pittsburgh, PA

Working pattern and location restrictions need checking in the full posting.

Work authorization
- Flexible work arrangements - Visa sponsorship available for exceptional candidates Interview Process

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.