Back to jobs

Principal Engineer – Data Intelligence

United States of America

Live, first seen by us 84 days ago
Pay
$143,625–299,375/yearLocation-specific pay — pay source
We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome. The compensation for this position ranges from $143,625.00 - $299,375.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more. Currently work for Yahoo? Please apply on our internal career site.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

Before you apply

Employer’s visa record
461 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll work on

Full posting

We are seeking a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms operating at Yahoo scale.

This role sits at the intersection of large-scale distributed data systems, enterprise knowledge, Retrieval-Augmented Generation (RAG), and agentic AI.

  • Define technical vision and architecture for the AI data intelligence platform

  • Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka

  • Build production RAG and multi-agent systems with semantic metadata integration

  • Establish evaluation frameworks for retrieval quality, agent accuracy, and hallucination rate

  • Drive adoption of RAG and agentic patterns across engineers

From the employer’s posting
We are seeking a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms operating at Yahoo scale.
This role sits at the intersection of large-scale distributed data systems, enterprise knowledge, Retrieval-Augmented Generation (RAG), and agentic AI. You will define how AI reasons over Yahoo's data ecosystem to help teams detect anomalies, diagnose incidents, understand dependencies, discover trusted data, optimize infrastructure, and automate complex operational workflows.
Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
Establish evaluation frameworks — retrieval quality, agent accuracy, hallucination rate, operational safety
Drive adoption of RAG and agentic patterns across engineers.

What you’ll bring

All qualifications

Core experience

  • 10+ years building distributed systems and large-scale data platforms, or equivalent experience.
  • Degree in CS, AI/ML, Engineering, Math, or related field,
  • Deep Python expertise and strong software engineering fun
  • Strong communication and technical leadership across cross-functional stakeholders.

Preferred experience

  • Knowledge graphs and semantic reasoning systems.
Qualification wording
10+ years building distributed systems and large-scale data platforms, or equivalent experience.
Degree in CS, AI/ML, Engineering, Math, or related field,
Deep Python expertise and strong software engineering fun
Strong communication and technical leadership across cross-functional stakeholders.
Knowledge graphs and semantic reasoning systems.

About Yahoo

Our mission is to build the intelligence and reasoning layer over Yahoo's enterprise data ecosystem—connecting metadata, lineage, operational telemetry, business context, and governance signals so teams can understand what is happening across complex data systems and take action with confidence.

In the employer’s words · Read in context

Apply at Yahoo

Posting record

Report an error
Status in our records
Live
First seen by us
Aug 21, 202684 days ago
Recorded sightings
110
Last seen by us
Nov 13, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 84

Up longer than most. Similar jobs usually come down between day 4 and day 77.

At Yahoo, jobs usually come down by about day 121.

From 51 similar postings that came down, and 8 of Yahoo’s. Coming down is not always a hire.

Yahoo is hiring

4 open jobs

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • BigQuery
  • GCP
  • Kafka
  • Spark
Where the posting names them
- Degree in CS, AI/ML, Engineering, Math, or related field, - Deep Python expertise and strong software engineering fun - Production experience with batch and streaming processing (Kafka, or equivalent).
- Agentic AI frameworks (LangGraph, CrewAI, AutoGen, Semant) - GCP: Vertex AI, Gemini, BigQuery, Vector Search, Dataflow - Enterprise metadata, lineage, governance, or observability
- Define technical vision and architecture for Yahoo's AI-powered data intelligence platform. - Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka. - Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
- Deep Python expertise and strong software engineering fun - Production experience with batch and streaming processing (Kafka, or equivalent). - Shipped and operated RAG applications in production; search, and reranking.

Your next step

Complete your application on ouryahoo.wd5.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 134% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 2. The fewest in a week was 7, the most 65, and the latest week had 65.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Job description

View original posting ↗

It takes powerful technology to connect our brands and partners with an audience of hundreds of millions of people. Whether you’re looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business—and the world.

About Us

The Consumer Data’s Foundations & AI Platform Engineering team builds the foundational intelligence layer powering Yahoo's global ecosystem, processing over 100 PB of data daily for more than a billion users. We combine large-scale distributed data systems, enterprise knowledge and metadata, and modern AI to transform how data is discovered, understood, trusted, governed, and operated across the company.

Our mission is to build the intelligence and reasoning layer over Yahoo's enterprise data ecosystem—connecting metadata, lineage, operational telemetry, business context, and governance signals so teams can understand what is happening across complex data systems and take action with confidence.

About the Role

We are seeking a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms operating at Yahoo scale.

This role sits at the intersection of large-scale distributed data systems, enterprise knowledge, Retrieval-Augmented Generation (RAG), and agentic AI. You will define how AI reasons over Yahoo's data ecosystem to help teams detect anomalies, diagnose incidents, understand dependencies, discover trusted data, optimize infrastructure, and automate complex operational workflows.

As a Principal Engineer, you will establish technical direction and reference architectures for enterprise AI systems while building reusable platform capabilities that can be adopted across engineering, analytics, governance, and business organizations.

You will also help shape how Yahoo engineers use AI to build software—leveraging AI-assisted development, evaluation, and automation to accelerate engineering while maintaining rigorous standards for correctness, reliability, security, and operational safety.

What you'll build

Systems that answer questions like:

  • Why did engagement decline after last week's deployment?

  • What breaks downstream if we change this schema?

  • What's the root cause of this data quality incident?

  • Which datasets should I trust for this decision?

  • Where can we cut capacity waste without slowing consumer queries?

Delivered through natural language interfaces over enterprise metadata and operational telemetry, serving executives, data producers, data consumers, and governance teams.

Responsibilities

  • Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.

  • Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.

  • Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.

  • Establish evaluation frameworks — retrieval quality, agent accuracy, hallucination rate, operational safety — with automated benchmarking, so we ship AI we can trust.

  • Use AI development tools to accelerate design, implement the bar for how the org validates AI-generated code and agent plans.

  • Drive adoption of RAG and agentic patterns across engineers.

  • Partner with product, governance, infrastructure, and exit-form priorities.

Basic Qualifications

  • 10+ years building distributed systems and large-scale data platforms, or equivalent experience.

  • Degree in CS, AI/ML, Engineering, Math, or related field,

  • Deep Python expertise and strong software engineering fun

  • Production experience with batch and streaming processing (Kafka, or equivalent).

  • Shipped and operated RAG applications in production; search, and reranking.

  • Track record evaluating and validating AI-generated code correctness and operational safety.

  • Strong communication and technical leadership across cross-functional stakeholders.

Preferred Qualifications

  • Agentic AI frameworks (LangGraph, CrewAI, AutoGen, Semant)

  • GCP: Vertex AI, Gemini, BigQuery, Vector Search, Dataflow

  • Enterprise metadata, lineage, governance, or observability

  • Knowledge graphs and semantic reasoning systems.

  • Daily use of AI pair-programming tools (Claude, Copilot, g workflows).

  • Led large technical initiatives influencing strategy across multiple teams.

The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!

Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form (www.yahooinc.com/careers/contact-us.html) or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.

We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.

The compensation for this position ranges from $143,625.00 - $299,375.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.

Currently work for Yahoo? Please apply on our internal career site.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome. The compensation for this position ranges from $143,625.00 - $299,375.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more. Currently work for Yahoo? Please apply on our internal career site.
Location & working pattern

United States of America

This passage needs a closer read in the full description.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.