Back to jobs

Senior AI/ML Engineer – Agent Harness & Runtime

Reads like an AI Engineer role: building products on existing AI models.

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Pasadena or San Francisco Full-time Apply now
Pasadena or San Francisco Full-time Senior AI/ML Engineer – Forward Deployment
Pasadena or San Francisco Full-time Senior AI/ML Engineer – Kernel Optimization
Read the full posting

What you’ll work on

Full posting

We are seeking a Senior-level (or higher) AI/ML Engineer to design and build the agent harness and runtime that turn Bonsai models into reliable, useful agents.

You will own the harness from architecture through production, working closely with model, infrastructure, and product teams.

  • Build the core agent execution loop with tool calls, structured outputs, and error recovery

  • Build context and memory systems for long-running tasks, including compaction and session state

  • Design task orchestration with checkpointing, cancellation, retries, and resumable execution

  • Build extensible tool interfaces for APIs, browsers, terminals, filesystems, and apps

  • Build evaluations, regression suites, and traces to measure task completion and diagnose failures

From the employer’s posting
We are seeking a Senior-level (or higher) AI/ML Engineer to design and build the agent harness and runtime that turn Bonsai models into reliable, useful agents. This role focuses on the systems surrounding the model: the execution loop, tool interfaces, context and memory management, task orchestration, and evaluation infrastructure that enable agents to complete complex workflows.
You will own the harness from architecture through production, working closely with model, infrastructure, and product teams. A central challenge is making efficient models effective at real tasks: determining what the model needs from its environment, measuring where execution breaks down, and improving the system across cloud, local, and resource-constrained deployments.
Developing the core agent execution loop, including model invocation, tool selection and execution, structured outputs, stopping conditions, and error recovery
Building context and memory systems for long-running tasks, including retrieval, context compaction, persistent session state, and reusable skills
Designing reliable task orchestration with checkpointing, cancellation, retries, and resumable execution
Building extensible tool interfaces and integrations with APIs, browsers, terminals, filesystems, and external applications
Developing task-based evaluations, regression suites, execution traces, and debugging tools to measure completion quality and diagnose failures

What you’ll bring

All qualifications

Core experience

  • You bring experience building reliable agent systems and production LLM applications:
  • Proven ability to mentor and collaborate effectively with other engineers
  • 5–8+ years of experience in software engineering, ML systems, distributed systems, or developer infrastructure
  • Hands-on experience building agents or LLM applications involving tool use, multi-step execution, and state management
  • Solid understanding of concurrency, asynchronous execution, persistence, and failure recovery
  • Practical understanding of LLM behavior, including context limitations, tool calling, structured outputs, and the interaction between prompts, models, and execution environments

Preferred experience

  • Experience building or contributing to agent harnesses, runtimes, or frameworks such as Hermes Agent, Codex CLI, OpenHands, or comparable open-source systems
  • Experience with durable workflow engines, sandboxed code execution, container runtimes, or secure tool execution
  • Familiarity with inference runtimes such as llama.cpp, MLX, or vLLM, and integrating locally hosted or open-weight models into agent systems
  • Experience making smaller or quantized models reliable in agent loops, including constrained decoding, grammar-based structured outputs, and tool schemas and context budgets adapted to model capability
Qualification wording
You bring experience building reliable agent systems and production LLM applications:
Proven ability to mentor and collaborate effectively with other engineers
5–8+ years of experience in software engineering, ML systems, distributed systems, or developer infrastructure
Hands-on experience building agents or LLM applications involving tool use, multi-step execution, and state management
Solid understanding of concurrency, asynchronous execution, persistence, and failure recovery
Practical understanding of LLM behavior, including context limitations, tool calling, structured outputs, and the interaction between prompts, models, and execution environments
Experience building or contributing to agent harnesses, runtimes, or frameworks such as Hermes Agent, Codex CLI, OpenHands, or comparable open-source systems
Experience with durable workflow engines, sandboxed code execution, container runtimes, or secure tool execution
Familiarity with inference runtimes such as llama.cpp, MLX, or vLLM, and integrating locally hosted or open-weight models into agent systems
Experience making smaller or quantized models reliable in agent loops, including constrained decoding, grammar-based structured outputs, and tool schemas and context budgets adapted to model capability

About PrismML

PrismML builds high-performance foundation models designed to run efficiently across a wide range of environments—from edge devices to large-scale deployments.

In the employer’s words · Read in context

Apply at PrismML

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Similar jobs usually come down between day 1 and day 15.

From 1,371 similar postings that came down. Coming down is not always a hire.

PrismML is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
Where the posting names them
- 5–8+ years of experience in software engineering, ML systems, distributed systems, or developer infrastructure - Strong programming skills in Python and experience building maintainable services, APIs, and developer tooling - Hands-on experience building agents or LLM applications involving tool use, multi-step execution, and state management

Your next step

Complete your application on prismml.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

LAUNCH
1001011100 001 11010 1 001011
Senior AI/ML Engineer – Agent Harness & Runtime
Pasadena or San Francisco
Full-time

About Us

PrismML builds high-performance foundation models designed to run efficiently across a wide range of environments—from edge devices to large-scale deployments. Our work spans models from ~1B to 100B+ parameters across LLMs, diffusion models, and other modalities, with a strong focus on scalable training, efficient inference, and real-world deployment. Today, that means a 27B-class model that runs on a phone in about 4 GB, down from roughly 54 GB at full precision.

Our Bonsai family of 1-bit and ternary models is designed to dramatically improve the efficiency of modern AI systems, enabling advanced intelligence to run with significantly lower memory usage, latency, and energy consumption across cloud and edge environments.

Role Overview

We are seeking a Senior-level (or higher) AI/ML Engineer to design and build the agent harness and runtime that turn Bonsai models into reliable, useful agents. This role focuses on the systems surrounding the model: the execution loop, tool interfaces, context and memory management, task orchestration, and evaluation infrastructure that enable agents to complete complex workflows.

You will own the harness from architecture through production, working closely with model, infrastructure, and product teams. A central challenge is making efficient models effective at real tasks: determining what the model needs from its environment, measuring where execution breaks down, and improving the system across cloud, local, and resource-constrained deployments.

Responsibilities

You will design, build, and optimize the systems that enable Bonsai-powered agents to perform real work. Core responsibilities include:

  • Developing the core agent execution loop, including model invocation, tool selection and execution, structured outputs, stopping conditions, and error recovery
  • Building context and memory systems for long-running tasks, including retrieval, context compaction, persistent session state, and reusable skills
  • Designing reliable task orchestration with checkpointing, cancellation, retries, and resumable execution, including coordination across multiple agents where appropriate
  • Building extensible tool interfaces and integrations with APIs, browsers, terminals, filesystems, and external applications
  • Implementing execution safeguards, including sandboxing, scoped permissions, credential handling, defenses against prompt injection from untrusted content, and human approval for sensitive actions
  • Developing task-based evaluations, regression suites, execution traces, and debugging tools to measure completion quality and diagnose failures
  • Optimizing task success, latency, token usage, memory consumption, and cost across model configurations and deployment environments
  • Collaborating with research and post-training teams to turn agent failures and execution traces into actionable model improvements, and to reuse harness tasks as reinforcement-learning environments

Basic Qualifications

You bring experience building reliable agent systems and production LLM applications:

  • 5–8+ years of experience in software engineering, ML systems, distributed systems, or developer infrastructure
  • Strong programming skills in Python and experience building maintainable services, APIs, and developer tooling
  • Hands-on experience building agents or LLM applications involving tool use, multi-step execution, and state management
  • Solid understanding of concurrency, asynchronous execution, persistence, and failure recovery
  • Practical understanding of LLM behavior, including context limitations, tool calling, structured outputs, and the interaction between prompts, models, and execution environments
  • Ability to take an ambiguous technical problem from initial design through implementation, deployment, and iteration
  • Strong written and verbal communication skills
  • Proven ability to mentor and collaborate effectively with other engineers

Preferred Qualifications

You have additional experience aligned with agent systems and efficient model deployment:

  • Experience building or contributing to agent harnesses, runtimes, or frameworks such as Hermes Agent, Codex CLI, OpenHands, or comparable open-source systems
  • Experience with durable workflow engines, sandboxed code execution, container runtimes, or secure tool execution
  • Familiarity with inference runtimes such as llama.cpp, MLX, or vLLM, and integrating locally hosted or open-weight models into agent systems
  • Experience making smaller or quantized models reliable in agent loops, including constrained decoding, grammar-based structured outputs, and tool schemas and context budgets adapted to model capability
  • Experience building agents that run fully on-device or offline, without a cloud fallback
  • Experience designing agent benchmarks, task environments, automated graders, or evaluation methods that account for nondeterministic behavior
  • Familiarity with model routing, prompt and prefix caching, and tradeoffs between model capability, execution speed, and cost
  • Contributions to open-source AI infrastructure, developer tools, or technically substantial independent projects

Ideal Candidate Profile

You have built systems that keep working when models make mistakes, tools fail, and tasks take longer than expected. You can move between inspecting an agent trace, improving context selection, and debugging a runtime failure. You use measured task outcomes to guide architectural decisions and know when to introduce an abstraction or simplify one.

You are excited by the opportunity to make highly efficient models useful across a much wider range of devices and workflows. You bring strong systems judgment, clear technical opinions grounded in experience, and the ownership to turn an early harness into infrastructure that developers and users can depend on.

Join the team

Thanks, your application has been received!
Oops! Something went wrong while submitting the form.

Contact us

Have a question, partnership idea, or a project that needs efficient intelligence? Reach out—we’d love to hear from you.
Thanks, your message has been received!
Oops! Something went wrong while submitting the form.
Thanks, your message has been received!
Oops! Something went wrong while submitting the form.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Pasadena or San Francisco

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.