Back to jobs

Engineering Manager, Big Data, Job Understanding

Pay
$200,000–265,000/year · BaseAnnual period assumed — pay source
Employer-matched 401(k) plan The US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations. Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Lead, mentor, and unblock a team of 5 senior engineers

  • Drive the rebuild of the job ingestion pipeline

  • Improve input data quality and handle user-generated content

  • Lead improvements to fraud detection and blocking

  • Scale data pipelines for performance and maintainability

From the employer’s posting
Lead, mentor, and unblock a senior team of 5 engineers
Drive the rebuild of the job ingestion pipeline
Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
Own and lead improvements to fraud detection and blocking mechanisms.
Scale our data pipelines both for performance and maintainability

Before you apply

Employer’s visa record
41 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • 5+ years of professional software development experience
  • 2+ years as a software engineering leader
  • Deep experience with big data frameworks such as Spark, Hadoop, Hive
  • Streaming technologies such as Kafka, Flink, Beam
  • Experience dealing with messy or unreliable data
Qualification wording
5+ years of professional software development experience.
2+ years of experience as a software engineering leader
Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
Streaming technologies (Kafka, Flink, Beam).
Must have experience dealing with messy/unreliable data

About Ziprecruiter

To actively connect people to their next great opportunity.

In the employer’s words · Read in context

Apply at Ziprecruiter

Posting record

Report an error

Actively hiringFirst seen by us 10 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 10, 202610 days ago
Recorded sightings
11
Last seen by us
Nov 20, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$200K–$265K against $155K–$227K, the middle half of what similar US postings state.

From 3,228 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 10

Similar jobs usually come down between day 8 and day 57.

Well past Ziprecruiter’s usual: its jobs come down by about day 2.

From 9,920 similar postings that came down, and 7 of Ziprecruiter’s. Coming down is not always a hire.

Ziprecruiter is hiring

18 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Leadership hiring is picking up
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Scala
  • AWS
  • Azure
  • Delta Lake
  • Docker
  • GCP
  • Hadoop
  • HBase
  • Hive
  • Kafka
  • Kubernetes
  • Spark
Where the posting names them
- Modern data storage solutions (Delta Lake, HBase, Hudi). - Scala As part of our team you’ll enjoy:
Preferred Qualifications: - Cloud platforms (GCP, AWS, Azure). - Modern data storage solutions (Delta Lake, HBase, Hudi).
- Cloud platforms (GCP, AWS, Azure). - Modern data storage solutions (Delta Lake, HBase, Hudi). - Scala
- Strong CS fundamentals (data structures, algorithms) and coding skills. - Experience with containerization technologies like Docker and Kubernetes. - Experience working on a B2C or B2B Product
- 2+ years of experience as a software engineering leader - Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive). - Streaming technologies (Kafka, Flink, Beam).
- Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive). - Streaming technologies (Kafka, Flink, Beam). - Strong CS fundamentals (data structures, algorithms) and coding skills.

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Has Ziprecruiter posted this job before?

Yes. We’ve followed one other Engineering Manager, Big Data, Job Understanding job there since November 2026. It is still up.

  1. Place not statedStill up after 11 days, first seen Nov 10
  2. This jobUp 11 days so far, first seen Nov 10

Job description

View original posting ↗

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.)

Our Mission: 

To actively connect people to their next great opportunity. 

Who We Are: 

ZipRecruiter is a leading online employment marketplace. Powered by AI-driven smart matching technology, the company actively connects millions of all-sized businesses and job seekers through innovative mobile, web, and email services, as well as through partnerships with the best job boards on the web. ZipRecruiter has the #1 rated job search app on iOS & Android.

About the Team:

Recommendations Ecosystem

The Recommendations Ecosystem group owns the intelligence that connects job seekers and jobs in our marketplace. We aim to understand every job and every job seeker well enough to make matches that work for both sides. We structure and enrich the jobs corpus, build the foundational models that encode jobs and job seekers, and run the matching engines that put the right opportunities in front of the right people.

What our team owns

Our group is the authoritative source for job understanding and matching intelligence, focusing on accuracy, relevance, and trust:

  • Jobs Corpus Understanding: ZipRecruiter takes in millions of job postings from employers, partners, and feeds. We own the ingestion and enrichment pipelines that turn raw postings into structured data. We use ML classifiers to infer job attributes like education requirements and pay, and we attach company and location data. We find and suppress fraudulent listings or terms of use violations, so the marketplace stays safe and worth using. The result is a canonical view of every job that recommendations, search, and employer products build on.
  • Foundational Models and Embeddings: At the core of ZipRecruiter's matching ecosystem are models that encode everything we can learn about jobs and job seekers. We build LLM-based embedding models from job content, resumes, and behavioral signals. These are the building blocks for matching and other ML models across the company, and we serve them at scale online and in batch.
  • Matching Engines: We are responsible for the ML systems that recommend jobs to job seekers and job seekers to employers across our app, website, and email. The engines cover large-scale candidate retrieval over vector DBs and orchestration that delivers fresh, personalized recommendations.

About the Job:

ZipRecruiter’s Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within this group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence.

We are seeking an Engineering Manager to lead an experienced, high-impact engineering team. In this role, you will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems.

  • Lead, mentor, and unblock a senior team of 5 engineers responsible for core job ingestion pipelines and data stores.
  • Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
  • Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
  • Own and lead improvements to fraud detection and blocking mechanisms.
  • Partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
  • Ensure we can act on everything we learn about jobs in a scalable real time manner. Scale our data pipelines both for performance and maintainability so we can be ambitious about what data we collect and where we can personalize the job seeker experience. 

Minimum Qualifications:

  • 5+ years of professional software development experience.
  • 2+ years of experience as a software engineering leader
  • Deep experience with modern big data frameworks (e.g. Spark, Hadoop, Hive).
  • Streaming technologies (Kafka, Flink, Beam).
  • Strong CS fundamentals (data structures, algorithms) and coding skills.
  • Experience with containerization technologies like Docker and Kubernetes.
  • Experience working on a B2C or B2B Product
  • This role is for engineers who are talking with their Product Managers about problems to solve and turning them into engineering solutions. They are naturally curious, problem solvers, and deeply understand the product they work on.
  • Must have experience dealing with messy/unreliable data (third party data sets, data integrations, migrations) 

Preferred Qualifications:

  • Cloud platforms (GCP, AWS, Azure).
  • Modern data storage solutions (Delta Lake, HBase, Hudi).
  • Scala

As part of our team you’ll enjoy:

  • Competitive compensation
  • Exceptional benefits package
  • Flexible Vacation & Paid Time Off
  • Employer-matched 401(k) plan 

The US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations.

Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.

ZipRecruiter is proud to be an equal opportunity employer and provides equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity or genetics.

Privacy Notice: For information about ZipRecruiter's collection and processing of job applicant personal data for this job, please see our Privacy Notice at: https://www.ziprecruiter.com/careers/job-applicant-privacy-notice

About Ziprecruiter

People
About 923 in 2024.Benefit plan filings (Form 5500)
Company
Listed as ZIP.

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 752, the most 1,164, and the latest week had 785.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Employer-matched 401(k) plan The US base salary range for this full-time position is $200,000 - $265,000. Our salary ranges are determined by role, level, and location, and the range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location, role-related knowledge and skills, depth of experience, relevant education or training, and additional role-related considerations. Depending on the position offered, equity, bonuses, commission, or other forms of compensation may also be provided as part of a total compensation package, in addition to a full range of medical, financial, and other benefits.
Location & working pattern

Santa Monica, CA

We offer a hybrid work environment. Most US-based positions can also be performed remotely (any exceptions will be noted in the Minimum Qualifications below.) Our Mission:
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.