Time since we first saw it
Day 3
Similar jobs usually come down between day 3 and day 42.
From 633 similar postings that came down. Coming down is not always a hire.
United States
Actively hiring, first seen by us 3 days agoCompensation and benefits $170K-$270K base salary. Competitive equity.Read the full posting
Employment type in the employer’s posting: Full-timeFrom the employer’s posting
Design and build production benchmarks and evaluations with customers and researchers
Build and own backend infrastructure for pipelines, execution, storage and orchestration
Create sandboxed environments for agentic evaluations with tools and code execution
Own the engineering side of customer engagements from scoping to production delivery
Spot repeatable evaluation patterns and infrastructure gaps that could become products
Define, design, and build production benchmarks and evaluations with customers and internal researchers.
Build and own backend infrastructure, including data pipelines, execution environments, storage, and orchestration.
Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.
Own the engineering portion of customer engagements from technical scoping through production delivery.
Identify repeatable evaluation patterns and infrastructure gaps that can become scalable products.
4 or more years of engineering experience, including hands-on machine learning model evaluation work.
Experience building evaluations or human-data pipelines for large language models.
Experience deploying end-to-end ML evaluation or benchmark systems to production against demanding customer timelines.
Experience working directly with AI researchers or foundation-model labs.
Strong proficiency with ML evaluation frameworks and benchmark design, including approaches such as LLM-as-judge.
Ownership of backend and infrastructure systems such as large-scale data pipelines, execution environments, storage, and orchestration.
Our client is a fast-growing AI data infrastructure company building a secure marketplace and data lab for high-quality model-training data.
In the employer’s words · Read in context
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Similar jobs usually come down between day 3 and day 42.
From 633 similar postings that came down. Coming down is not always a hire.
102 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume to compare the role’s scope, tools and requirements with your experience.
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
About the company
Our client is a fast-growing AI data infrastructure company building a secure marketplace and data lab for high-quality model-training data. The company helps data holders license sensitive, real-world datasets to vetted AI teams while protecting governance, privacy, intellectual property, and security. It has raised $65 million, including a $55 million Series A backed by leading venture firms, employs approximately 80 people, and is scaling quickly after reaching its full-year growth target early.
The role and why it matters
This is the first Machine Learning Engineer dedicated to the company's Benchmarks and Evaluations vertical. You will partner directly with the general manager, researchers, and early enterprise customers to establish the technical foundation for evaluating foundation models across domains and modalities. The role combines hands-on ML evaluation, backend infrastructure, and customer-facing delivery in a high-ownership environment.
What you'll do
• Define, design, and build production benchmarks and evaluations with customers and internal researchers.
• Build and own backend infrastructure, including data pipelines, execution environments, storage, and orchestration.
• Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.
• Own the engineering portion of customer engagements from technical scoping through production delivery.
• Identify repeatable evaluation patterns and infrastructure gaps that can become scalable products.
• Move quickly through ambiguity while maintaining strong technical judgment and clear written communication.
Requirements
What we're looking for
• 4 or more years of engineering experience, including hands-on machine learning model evaluation work.
• Experience deploying end-to-end ML evaluation or benchmark systems to production against demanding customer timelines.
• Strong proficiency with ML evaluation frameworks and benchmark design, including approaches such as LLM-as-judge.
• Ownership of backend and infrastructure systems such as large-scale data pipelines, execution environments, storage, and orchestration.
• Customer-facing engineering experience managing enterprise stakeholders.
• A degree in computer science, physics, or a related technical field.
• Current unrestricted U.S. work authorization without visa sponsorship.
Bonus points
• Experience building evaluations or human-data pipelines for large language models.
• Experience working directly with AI researchers or foundation-model labs.
• Published work or meaningful open-source contributions in ML evaluations or benchmarks.
• Early-stage B2B startup, forward-deployed engineering, or high-ownership generalist experience.
Benefits
Compensation and benefits
• $170K-$270K base salary.
• Competitive equity.
• Comprehensive benefits provided by a well-capitalized, high-growth company.
• High autonomy and the opportunity to build a new technical vertical from the ground up.
Location and work model
• Full-time and remote within the United States.
• Strong independent ownership, customer responsiveness, and cross-functional collaboration are expected.
New Forward Deployed Engineer postings at the employers we follow are up 225% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Forward Deployed Engineer, by the work the posting describes.
Forward deployed engineers are placed with their employer's customers: they learn a customer's problem and write the code that makes the employer's product solve it inside the customer's own systems.
Postings ask for strong software engineering, most often in Python, ease with customers and their executives, often travel, and in about three of four cases work with large language models or AI agents.
An AI engineer or data engineer builds for their own employer's product team; a forward deployed engineer does similar work inside a customer. We give this role to every posting whose title says forward deployed.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Compensation and benefits $170K-$270K base salary. Competitive equity.
United States
Location and work model • Full-time and remote within the United States. • Strong independent ownership, customer responsiveness, and cross-functional collaboration are expected.
• A degree in computer science, physics, or a related technical field. • Current unrestricted U.S. work authorization without visa sponsorship. Bonus points