Time since we first saw it
Day 1
Early. Similar jobs usually come down between day 4 and day 77.
From 51 similar postings that came down. Coming down is not always a hire.
San Francisco, California, United States
Actively hiring, first seen by us 1 day agoCompensation & Benefits $200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is available. The role description states that visa sponsorship is available. LocationRead the full posting
Employment type in the employer’s posting: FullTimeFrom the employer’s posting
Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and match or exceed human performance.
Design synthetic company environments with realistic email, records and files
Create graders and evaluation systems that can judge agents beyond human reviewer skill
Develop benchmarks that correlate with real-world production performance
Find and fix evaluation failures such as reward hacking and benchmark gaming
Simulate software tools such as inboxes and CRMs for agent interactions at scale
Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, shaping how agent competence is measured.
Design synthetic company environments with realistic email, records, and files for extended agent use.
Create robust graders and evaluation systems that can assess agents beyond the expertise of human reviewers.
Develop benchmarks that correlate with real-world production performance.
Find and fix evaluation failures, including reward hacking and benchmark gaming.
Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.
From the employer’s posting.
Actively hiringFirst seen by us 1 day ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 1
Early. Similar jobs usually come down between day 4 and day 77.
From 51 similar postings that came down. Coming down is not always a hire.
18 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume to compare the role’s scope, tools and requirements with your experience.
Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.
Already applied? Track this application
New AI Engineer postings at the employers we follow are up 134% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under AI Engineer, by the work the posting describes.
AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.
Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.
An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.
Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, shaping how agent competence is measured.
Design synthetic company environments with realistic email, records, and files for extended agent use.
Create robust graders and evaluation systems that can assess agents beyond the expertise of human reviewers.
Develop benchmarks that correlate with real-world production performance.
Find and fix evaluation failures, including reward hacking and benchmark gaming.
Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.
Hands-on experience with synthetic data pipelines, benchmarks, evaluations, or post-training; this is a research and engineering role, not a pure infrastructure position.
Experience building environments or benchmarks used to train or evaluate agents, and designing graders or evaluation systems for AI agents.
Experience simulating complex software systems for agent tool use, and identifying benchmark flaws or fixing reward hacking.
At least 1 to 2 years at a fast-growing or AI-focused startup, with relevant AI research or engineering experience.
Strong startup experience, such as founding a company or participating in an accelerator, and high-level competition experience in areas such as mathematics, programming, debate, or games.
Conviction that AI agents can outperform humans at many computer-based tasks.
$200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is available. The role description states that visa sponsorship is available.
On-site five days a week in San Francisco, California, United States.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation & Benefits $200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is available. The role description states that visa sponsorship is available. Location
San Francisco, California, United States
Compensation & Benefits $200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is available. The role description states that visa sponsorship is available. Location On-site five days a week in San Francisco, California, United States.
Compensation & Benefits $200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is available. The role description states that visa sponsorship is available. Location