Back to jobs

AI Engineer, RL & Evals

San Francisco, California, United States

Actively hiring, first seen by us 3 days ago
Pay
$175,000–275,000/year · Base — pay source
Compensation and benefits $175,000-$275,000 annual base salary. Competitive equity.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Build and scale RL environments and evaluation frameworks for creative domains

  • Design tasks and grading rubrics that capture design quality and taste

  • Build agent harnesses, context layers and supporting product infrastructure

  • Collaborate with research teams and frontier labs to improve model output quality

  • Ship production code end to end, including backend systems and data pipelines

From the employer’s posting
Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains.
Design tasks and grading rubrics that capture design quality and taste.
Build agent harnesses, context layers and supporting product infrastructure.
Collaborate with internal research teams and frontier labs to improve model output quality.
Ship production code end to end and build reliable backend systems and data pipelines.

Before you apply

Work authorization
Sponsors visas

What you’ll bring

All qualifications

Core experience

  • 2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems.
  • Experience at creative technology, generative AI, crawling, indexing or data companies.
  • Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs.
  • Experience connecting research work to practical products and infrastructure.
  • Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable.
  • Ability to work in the San Francisco office five days per week.
Qualification wording
2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems.
Experience at creative technology, generative AI, crawling, indexing or data companies.
Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs.
Experience connecting research work to practical products and infrastructure.
Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable.
Ability to work in the San Francisco office five days per week.

About Raydar

Our client is a seed-stage AI company building the data and infrastructure layer that improves model quality in subjective, creative domains, starting with design.

In the employer’s words · Read in context

Apply at Raydar

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026
Employer says posted
Oct 12, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Similar jobs usually come down between day 1 and day 15.

From 1,376 similar postings that came down. Coming down is not always a hire.

Raydar is hiring

102 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • PyTorch
Where the posting names them
• Strong full-stack or backend engineering skills and demonstrated production shipping experience. • Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs. • Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable.

Your next step

Complete your application on apply.workable.com. The employer’s form will show what is required.

Applying through Workable

  • No account needed. You can import your resume to fill in the form, or skip that and fill it in yourself.

Already applied? Track this application

Job description

View original posting ↗

About the company

Our client is a seed-stage AI company building the data and infrastructure layer that improves model quality in subjective, creative domains, starting with design. It has raised $18.5M and has revenue-generating partnerships with frontier AI labs and application-layer companies. Its products support post-training, reinforcement learning, context and verification.

The role

As AI Engineer, RL & Evals, you will build reinforcement learning environments, evaluation frameworks and production infrastructure for creative domains. You will combine backend or full-stack product engineering with applied ML and own systems from design through delivery.

What you'll do

• Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains.

• Design tasks and grading rubrics that capture design quality and taste.

• Build agent harnesses, context layers and supporting product infrastructure.

• Collaborate with internal research teams and frontier labs to improve model output quality.

• Ship production code end to end and build reliable backend systems and data pipelines.

Requirements

What we're looking for

• 2-7 years of relevant AI or reinforcement learning engineering experience, with depth building RL environments, evaluation systems or ML post-training systems.

• Strong full-stack or backend engineering skills and demonstrated production shipping experience.

• Experience with Python, PyTorch, RL, ML evaluation frameworks and LLMs.

• Knowledge of distributed systems and data pipelines; relevant scraping, indexing, embedding or agent-harness work is valuable.

• A computer science degree and fluent English communication.

• Ability to work in the San Francisco office five days per week.

Bonus points

• Experience at creative technology, generative AI, crawling, indexing or data companies.

• Building agentic frameworks or evaluations for non-verifiable domains.

• Experience connecting research work to practical products and infrastructure.

Benefits

Compensation and benefits

• $175,000-$275,000 annual base salary.

• Competitive equity.

Location and work model

Full-time, on-site five days per week in Levi's Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation and benefits $175,000-$275,000 annual base salary. Competitive equity.
Location & working pattern

San Francisco, California, United States

Location and work model Full-time, on-site five days per week in Levi's Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported.
Work authorization
Location and work model Full-time, on-site five days per week in Levi's Plaza, San Francisco, California. Visa transfers, including OPT and H1B transfers, are supported.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.