Back to jobs

Applied AI Engineer - Agent

Reads like an ML Engineer role: training models and running them in production.

New York · New York, United States

Open 5 months, first seen by us 173 days ago
Pay
Pay not listedSimilar roles state $166K–$237K
Work setting
On-site — work setting source
Location type: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Agents — team source

What you’ll work on

Full posting
  • Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths

  • Partner with product and infra to define success metrics and ship fast, safe iterations

  • Write clean, well-tested code; document design decisions and runbooks

From the employer’s posting
What You’ll Do Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes Partner with product and infra to define success metrics and ship fast, safe iterations Write clean, well-tested code; document design decisions and runbooks
Partner with product and infra to define success metrics and ship fast, safe iterations Write clean, well-tested code; document design decisions and runbooks What You’ll Bring

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Do you require visa sponsorship?
From the employer’s application form

Posting record

Report an error

Open 5 monthsWe first saw this posting 173 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 2, 2026173 days ago
Recorded sightings
67
Last seen by us
Nov 21, 2026
Employer says posted
Sep 29, 2025

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$166K–$237K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 1,537 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 173

Up longer than most. Similar jobs usually come down between day 7 and day 76.

From 6,398 similar postings that came down. Coming down is not always a hire.

The General Intelligence Company of New York is hiring

1 open job

  • No new data jobs since June
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Datadog
  • Redis
  • PostgreSQL
Where the posting names them
What You’ll Bring - 4+ years backend engineering experience, preferably Python (we care about impact over years) - Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you’ve shipped LLM features to production
- Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs - Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization Why Join Us
- RAG systems in production (chunking, retrieval quality, freshness strategies) - Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs - Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

We’re hiring an Applied AI Engineer to push the boundaries of our Cofounder agent. You’ll own core backend systems and applied LLM work: advancing agent reliability and autonomy, building evaluation pipelines, and shipping techniques that measurably improve agent performance. This is a hands-on role with high ownership across research-to-production: prototyping, instrumenting, evaluating, and deploying improvements that show up directly in user outcomes.

What You’ll Do

  • Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths

  • Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)

  • Productionize applied LLM techniques: function/tool-calling orchestration, self-reflection, retrieval/RAG, multi-agent handoffs, caching/embedding strategies, and hallucination reduction

  • Improve core backend systems: reliable job orchestration, retries/backoff, idempotency, and auditability; scalable memory and context routing; data pipelines across Gmail, Slack, Notion, Linear, Google Workspace, etc.; observability and tracing for agent actions/outcomes

  • Partner with product and infra to define success metrics and ship fast, safe iterations

  • Write clean, well-tested code; document design decisions and runbooks

What You’ll Bring

  • 4+ years backend engineering experience, preferably Python (we care about impact over years)

  • Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you’ve shipped LLM features to production

  • Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)

  • Solid distributed systems fundamentals: concurrency, reliability, performance, data modeling, lifecycle management

  • Pragmatic experimentation: hypothesis → prototype → measured improvement → rollout

  • Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild

Nice To Have

  • Experience with agent frameworks, tool orchestration, and memory architectures

  • RAG systems in production (chunking, retrieval quality, freshness strategies)

  • Redis, Postgres/Supabase, queues (e.g., Celery/Arq/SQS), and event-driven designs

  • Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization

Why Join Us

  • Mission: build autonomous agents that run entire businesses

  • Impact: ship core agent improvements that users feel immediately

  • Velocity: small, senior team; fast decision cycles; high ownership

  • Stack: modern tooling across AI orchestration, integrations, and memory systems

Compensation

  • Competitive salary and meaningful equity

  • Comprehensive benefits and flexible work setup

Demand for ML Engineer roles

New ML Engineer postings at the employers we follow are down 4% over the last 6 weeks compared with the 6 before.

Weekly new ML Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 508, the most 899, and the latest week had 508.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under ML Engineer, by the work the posting describes.

ML engineers put machine learning models into products. They write the code that trains, ships, serves and monitors models so a recommendation or prediction works for real users.

Postings ask for strong Python and software engineering, a framework such as PyTorch, cloud services, and more and more often experience with large language models.

A data scientist often works out which model to build; an ML engineer makes it run reliably in production.

US government figures for computer and information research scientists

Median yearly pay, May 2025
$140,300
Expected change, 2025 to 2035
21.8% more jobsagainst 3.5% for all jobs

The government has no code for ML engineers, so these figures are for the closest group, computer and information research scientists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1221.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

New York, United States

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.