Back to jobs

Senior AI Engineer

Pay
Multiple pay amounts — pay source
The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV. The estimated salary range for this role, based on the qualifications set forth in the job description, is between $131,000 $241,000. This role will also be eligible for bonus/commission (as applicable), equity, and benefits. The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles and recognize that the person we hire may be more or less experienced than this job description as posted.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Knowledge of responsible AI practices, including bias mitigation and hallucination reduction strategies This position is full-time and located in our New York City headquarters offices offering a hybrid work model from office and remote. The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV.
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting

We are looking for a talented and driven Senior AI Engineer to join the Pinnacle AI (PinAI) team at DoubleVerify.

You will design and implement AI agents, Model Context Protocol (MCP) servers, and LLM-backed tools that allow Fortune 500 clients to interact with their advertising data through natural language.

  • Design, build, and maintain AI agents within the AgentOS framework using architectures based on MCP (Model Context Protocol), LangChain, LangGraph, and related tooling

  • Work with major LLM providers (OpenAI, Anthropic, Google, and others) to select, prompt, and integrate models appropriate for specific agent tasks

  • Build and maintain evaluation (evals) frameworks that measure agent accuracy, instruction-following, hallucination rates, and user satisfaction

From the employer’s posting
We are looking for a talented and driven Senior AI Engineer to join the Pinnacle AI (PinAI) team at DoubleVerify. In this role, you will be a core builder of AgentOS — our agentic AI platform that powers conversational, intelligent experiences across the Pinnacle advertising analytics suite.
You will design and implement AI agents, Model Context Protocol (MCP) servers, and LLM-backed tools that allow Fortune 500 clients to interact with their advertising data through natural language. This is a hands-on engineering role for someone who is passionate about applied AI, thrives in a fast-moving environment, and wants to see their work directly impact how the world's largest advertisers make decisions.
Agentic AI Development Design, build, and maintain AI agents within the AgentOS framework using architectures based on MCP (Model Context Protocol), LangChain, LangGraph, and related tooling Develop new MCP servers and tools that expose Pinnacle analytics capabilities — including metrics, dimensions, settings, and user data — to AI agents
LLM Engineering & Optimization Work with major LLM providers (OpenAI, Anthropic, Google, and others) to select, prompt, and integrate models appropriate for specific agent tasks Develop and own prompt engineering strategies, including system prompts, few-shot examples, and chain-of-thought techniques
Evaluation & Quality Build and maintain evaluation (evals) frameworks that measure agent accuracy, instruction-following, hallucination rates, and user satisfaction Define quality benchmarks and run regression evals on every agent change before production deployment

What you’ll bring

All qualifications

Core experience

  • 5+ years of professional software engineering experience building production-grade systems
  • Python: Strong Python proficiency; ability to build clean, testable, production-quality backend services
  • 2+ years of hands-on experience developing LLM-based applications or AI agent systems
  • Demonstrated experience shipping AI-powered features end-to-end, from prototype to production

Preferred experience

  • FastAPI experience a plus
  • Experience with MCP server development and tool-use patterns in production agentic systems
  • Experience with agent evaluation tools such as DeepEval, LangSmith, or Braintrust
  • Familiarity with IAM, Keycloak, or OAuth 2.0-based authentication patterns
Qualification wording
5+ years of professional software engineering experience building production-grade systems
Python: Strong Python proficiency; ability to build clean, testable, production-quality backend services (FastAPI experience a plus)
2+ years of hands-on experience developing LLM-based applications or AI agent systems
Demonstrated experience shipping AI-powered features end-to-end, from prototype to production
Experience with MCP server development and tool-use patterns in production agentic systems
Experience with agent evaluation tools such as DeepEval, LangSmith, or Braintrust
Familiarity with IAM, Keycloak, or OAuth 2.0-based authentication patterns

About DoubleVerify

DoubleVerify is the leading independent provider of marketing measurement software, data and analytics that authenticates the quality and effectiveness of digital media for the world's largest brands and media platforms.

In the employer’s words · Read in context

Apply at DoubleVerify

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 2, 202619 days ago
Recorded sightings
14
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 19

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,376 similar postings that came down. Coming down is not always a hire.

DoubleVerify is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • AWS
  • Azure
  • Docker
  • GCP
  • Kubernetes
  • Looker
  • Snowflake
  • FastAPI
  • React
Where the posting names them
- LLM Integration: Experience calling and integrating with LLM APIs (OpenAI, Anthropic Claude, Google Gemini, or similar), including streaming, tool-calling, and structured output patterns - Python: Strong Python proficiency; ability to build clean, testable, production-quality backend services (FastAPI experience a plus) - RAG & Embeddings: Understanding of retrieval-augmented generation patterns, vector stores, and semantic search
- Evaluation Mindset: Experience building or using eval frameworks to measure LLM/agent quality and regression-test AI behavior - Cloud & Infrastructure: Familiarity with cloud environments (GCP, AWS, or Azure) and containerization basics (Docker/Kubernetes) Soft Skills:
- Familiarity with IAM, Keycloak, or OAuth 2.0-based authentication patterns - Knowledge of advertising analytics, AdTech platforms, or BI tools (Looker, Snowflake, etc.) - Experience with modern front-end frameworks (React/Angular) for conversational UI features
- Knowledge of advertising analytics, AdTech platforms, or BI tools (Looker, Snowflake, etc.) - Experience with modern front-end frameworks (React/Angular) for conversational UI features - Contributions to open-source AI projects or published work in AI/ML

Your next step

Complete your application on doubleverify.wd5.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

Who We Are

DoubleVerify is the leading independent provider of marketing measurement software, data and analytics that authenticates the quality and effectiveness of digital media for the world's largest brands and media platforms. DV provides media transparency and accountability to deliver the highest level of impression quality for maximum advertising performance. Since 2008, DV has helped hundreds of Fortune 500 companies gain the most from their media spend by delivering best-in-class solutions across the digital advertising ecosystem, helping to build a better industry. Learn more at www.doubleverify.com.


Role Overview

We are looking for a talented and driven Senior AI Engineer to join the Pinnacle AI (PinAI) team at DoubleVerify. In this role, you will be a core builder of AgentOS — our agentic AI platform that powers conversational, intelligent experiences across the Pinnacle advertising analytics suite.


You will design and implement AI agents, Model Context Protocol (MCP) servers, and LLM-backed tools that allow Fortune 500 clients to interact with their advertising data through natural language. This is a hands-on engineering role for someone who is passionate about applied AI, thrives in a fast-moving environment, and wants to see their work directly impact how the world's largest advertisers make decisions.



What You'll Do

Agentic AI Development

  • Design, build, and maintain AI agents within the AgentOS framework using architectures based on MCP (Model Context Protocol), LangChain, LangGraph, and related tooling
  • Develop new MCP servers and tools that expose Pinnacle analytics capabilities — including metrics, dimensions, settings, and user data — to AI agents
  • Implement multi-turn conversational flows, tool-use reasoning chains, and agent orchestration logic that handle complex, real-world advertising analytics queries
  • Build and maintain the chat UI integration layer, connecting AgentOS to the Pinnacle front-end experience

LLM Engineering & Optimization

  • Work with major LLM providers (OpenAI, Anthropic, Google, and others) to select, prompt, and integrate models appropriate for specific agent tasks
  • Develop and own prompt engineering strategies, including system prompts, few-shot examples, and chain-of-thought techniques
  • Implement Retrieval-Augmented Generation (RAG) pipelines to ground AI responses in Pinnacle's proprietary data and documentation
  • Continuously optimize model performance through evals, latency tuning, and cost management

Evaluation & Quality

  • Build and maintain evaluation (evals) frameworks that measure agent accuracy, instruction-following, hallucination rates, and user satisfaction
  • Define quality benchmarks and run regression evals on every agent change before production deployment
  • Instrument agents with observability tooling (e.g., LangSmith, Weights & Biases, or custom tracing) to support debugging and continuous improvement

Integration & Platform Engineering

  • Integrate AgentOS with Pinnacle's existing platform services — including PIAM/Keycloak authentication, Settings APIs, and analytics data layers
  • Collaborate with backend teams to build and consume APIs that surface data cleanly and securely to AI agents
  • Participate in architecture reviews and contribute to technical design documents for new AI-powered features

Cross-Functional Collaboration

  • Partner closely with Product, UX, and Data Science to translate business requirements into agent capabilities and conversational flows
  • Work with QE teams to define testing strategies for AI features, including behavioral testing and adversarial prompting
  • Contribute to the team's shared AI engineering standards, best practices, and documentation



Who You Are

Required Qualifications


Experience:

  • 5+ years of professional software engineering experience building production-grade systems
  • 2+ years of hands-on experience developing LLM-based applications or AI agent systems
  • Demonstrated experience shipping AI-powered features end-to-end, from prototype to production

Technical Expertise:

  • Agentic AI Frameworks: Solid hands-on experience with LangChain, LangGraph, or equivalent agent orchestration frameworks
  • Model Context Protocol (MCP): Familiarity with MCP or similar modular tool-integration protocols for AI agents (or strong appetite to ramp quickly)
  • LLM Integration: Experience calling and integrating with LLM APIs (OpenAI, Anthropic Claude, Google Gemini, or similar), including streaming, tool-calling, and structured output patterns
  • Python: Strong Python proficiency; ability to build clean, testable, production-quality backend services (FastAPI experience a plus)
  • RAG & Embeddings: Understanding of retrieval-augmented generation patterns, vector stores, and semantic search
  • Evaluation Mindset: Experience building or using eval frameworks to measure LLM/agent quality and regression-test AI behavior
  • Cloud & Infrastructure: Familiarity with cloud environments (GCP, AWS, or Azure) and containerization basics (Docker/Kubernetes)

Soft Skills:

  • Strong problem-solving skills with a bias toward shipping and iterating
  • Clear communicator — able to explain AI behavior and limitations to both technical peers and non-technical stakeholders
  • Comfortable operating with ambiguity in a fast-paced, evolving AI landscape
  • Collaborative team player who contributes actively to shared standards and code quality

Education:

  • BS/MS in Computer Science, Machine Learning, AI, or a related technical field



Preferred Qualifications

  • Experience with MCP server development and tool-use patterns in production agentic systems
  • Familiarity with IAM, Keycloak, or OAuth 2.0-based authentication patterns
  • Knowledge of advertising analytics, AdTech platforms, or BI tools (Looker, Snowflake, etc.)
  • Experience with modern front-end frameworks (React/Angular) for conversational UI features
  • Contributions to open-source AI projects or published work in AI/ML
  • Experience with agent evaluation tools such as DeepEval, LangSmith, or Braintrust
  • Knowledge of responsible AI practices, including bias mitigation and hallucination reduction strategies


This position is full-time and located in our New York City headquarters offices offering a hybrid work model from office and remote.


The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV.


The estimated salary range for this role, based on the qualifications set forth in the job description, is between $131,000  $241,000. This role will also be eligible for bonus/commission (as applicable), equity, and benefits. 


The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles and recognize that the person we hire may be more or less experienced than this job description as posted.


Not-so-fun fact: Research shows that while men apply to jobs when they meet an average of 60% of job criteria, women and other marginalized groups tend to only apply when they check every box. So if you think you have what it takes but you’re not sure that you check every box, apply anyway!

About DoubleVerify

People
About 362 in 2025, up 7% from the year before.Annual report (SEC Form 10-K)
Company
Listed as DV.
H-1B visas
5 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV. The estimated salary range for this role, based on the qualifications set forth in the job description, is between $131,000 $241,000. This role will also be eligible for bonus/commission (as applicable), equity, and benefits. The range above is for the expectations as laid out in the job description; however, we are often open to a wide variety of profiles and recognize that the person we hire may be more or less experienced than this job description as posted.
Location & working pattern

NYC Global HQ

- Knowledge of responsible AI practices, including bias mitigation and hallucination reduction strategies This position is full-time and located in our New York City headquarters offices offering a hybrid work model from office and remote. The successful candidate’s starting salary will be determined by a number of non-discriminatory factors, including qualifications for the role, level, skills, experience, location, and internal equity relative to peers at DV.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.