Back to jobs

Lead Data Engineer (P3999)

Pay
USD 125,000–207,000/year · BaseAnnual period assumed — pay source
Base Pay Range $125,000—$207,000 USD
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Lead design and development of Databricks-based solutions and set engineering standards

  • Build streaming pipelines handling ordering, late data, duplicates, retries and replay

  • Design and build event-driven data solutions and define event schemas and contracts

  • Own operational health of pipelines, including incident response and root cause analysis

  • Provide day-to-day direction to a team of engineers

From the employer’s posting
Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards
Build streaming pipelines that handle ordering, late-arriving data, duplicates, retries, dead-letter handling, and replay or backfill
Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers
Own operational health of the pipelines you build, including incident response, root cause analysis, and meeting service level expectations
Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore

Before you apply

Employer’s visa record
3 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
QUALIFICATIONS, SKILLS, AND EXPERIENCE: - Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program, or equivalent experience - 5+ years of professional data engineering experience
Apply at 84.51°

Posting record

Report an error

Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 17, 2026today
Recorded sightings
2
Last seen by us
Nov 18, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$125K–$207K against $127K–$190K, the middle half of what similar US postings state.

From 2,396 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 0

Early. Similar jobs usually come down between day 6 and day 56.

At 84.51°, jobs usually come down by about day 40.

From 14,168 similar postings that came down, and 11 of 84.51°’s. Coming down is not always a hire.

84.51° is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Kafka
  • Kubernetes
  • Spark
  • PySpark
Where the posting names them
Lead Data Engineer (P3999) SUMMARY: As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud, using both batch and event-driven patterns. Our engineers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, SQL and JSON to build products, tools, and features that power applications serving our commercial products. You will provide technical leadership to a blended onshore/offshore team and work closely with Product, Data Science, and technical architects. Communication and collaboration with these partners are critical to success in this role. RESPONSIBILITIES: Take ownership of features and drive them to completion through all phases of the 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
- 5+ years developing with Spark (Databricks, PySpark) - 5+ years developing with Python and SQL - 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams
- 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams - Experience building event-driven or streaming data solutions with Spark Structured Streaming and a messaging platform such as Kafka, Azure Service Bus, or similar - Solid understanding of event-driven architecture concepts, including publish/subscribe, event sourcing, change data capture, delivery guarantees (at-least-once, exactly-once), idempotent processing, windowing and watermarking, and handling of out-of-order and late-arriving events
- Experience with schema management for events (for example Avro, Protobuf, or JSON Schema with a schema registry) and backward-compatible schema evolution - Experience with Azure data services such as ADLS, Azure Key Vault, Azure Kubernetes Service, and Azure Data Factory - Experience with CI/CD, Git-based workflows, code review, and infrastructure as code
PREFERRED: - Databricks or Azure certification - Experience migrating legacy orchestration or ETL to Databricks
- Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore - Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards in partnership with technical architects - Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers
- 5+ years of professional data engineering experience - 5+ years developing with Spark (Databricks, PySpark) - 5+ years developing with Python and SQL
- Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution - Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control - Experience building REST APIs (1+ years) and working with Kubernetes (1+ years)
- Databricks or Azure certification - Experience migrating legacy orchestration or ETL to Databricks - Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads
- Experience migrating legacy orchestration or ETL to Databricks - Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads - Experience with event-driven API patterns such as webhooks, asynchronous messaging, and event-carried state transfer
- Experience with CI/CD, Git-based workflows, code review, and infrastructure as code - Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution - Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control
- Build and maintain CI/CD pipelines, infrastructure as code, and environment promotion practices - Develop REST APIs hosted in Kubernetes - Partner with Data Science to deliver the data and feature pipelines needed for model development and deployment
- Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control - Experience building REST APIs (1+ years) and working with Kubernetes (1+ years) - Experience with production operations, including monitoring, on-call or incident response, and root cause analysis

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

84.51° Overview:

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.

Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.

Join us at 84.51°!

__________________________________________________________

 

Lead Data Engineer (P3999)

SUMMARY: 
As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud, using both batch and event-driven patterns. Our engineers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, SQL and JSON to build products, tools, and features that power applications serving our commercial products. You will provide technical leadership to a blended onshore/offshore team and work closely with Product, Data Science, and technical architects. Communication and collaboration with these partners are critical to success in this role.  

RESPONSIBILITIES: 
Take ownership of features and drive them to completion through all phases of the 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:  

  • Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore  
  • Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards in partnership with technical architects  
  • Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers  
  • Define and maintain event contracts and schemas, including versioning and schema evolution, in partnership with producing and consuming teams  
  • Build streaming pipelines that handle ordering, late-arriving data, duplicates, retries, dead-letter handling, and replay or backfill  
  • Develop business domain expertise and translate it for technical stakeholders  
  • Develop, maintain, and optimize data pipelines supporting different parts of our commercial business  
  • Design and document data models, schemas, workflows and operational procedures to support continuity  
  • Implement data quality checks, automated testing, monitoring and error handling that improve the reliability of our systems  
  • Own operational health of the pipelines you build, including incident response, root cause analysis, and meeting service level expectations, with monitoring of latency and consumer lag for streaming workloads  
  • Troubleshoot non-trivial data processing workflows  
  • Optimize pipelines for both performance and cost  
  • Apply data governance, privacy and security practices, including PII handling, access controls and lineage through Unity Catalog  
  • Build and maintain CI/CD pipelines, infrastructure as code, and environment promotion practices  
  • Develop REST APIs hosted in Kubernetes  
  • Partner with Data Science to deliver the data and feature pipelines needed for model development and deployment  
  • Use AI-assisted tools to improve development workflows, and review and validate the output you accept  
  • Collaborate with senior engineers to ensure consistent development practices  
  • Mentor and coach junior engineers  
  • Bring new perspectives to problems and be driven to improve yourself and the way things are done  

QUALIFICATIONS, SKILLS, AND EXPERIENCE:  

  • Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program, or equivalent experience  
  • 5+ years of professional data engineering experience  
  • 5+ years developing with Spark (Databricks, PySpark)  
  • 5+ years developing with Python and SQL  
  • 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams  
  • Experience building event-driven or streaming data solutions with Spark Structured Streaming and a messaging platform such as Kafka, Azure Service Bus, or similar 
  • Solid understanding of event-driven architecture concepts, including publish/subscribe, event sourcing, change data capture, delivery guarantees (at-least-once, exactly-once), idempotent processing, windowing and watermarking, and handling of out-of-order and late-arriving events  
  • Experience with schema management for events (for example Avro, Protobuf, or JSON Schema with a schema registry) and backward-compatible schema evolution  
  • Experience with Azure data services such as ADLS, Azure Key Vault, Azure Kubernetes Service, and Azure Data Factory 
  • Experience with CI/CD, Git-based workflows, code review, and infrastructure as code 
  • Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution  
  • Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control  
  • Experience building REST APIs (1+ years) and working with Kubernetes (1+ years)  
  • Experience with production operations, including monitoring, on-call or incident response, and root cause analysis  
  • Strong understanding of Agile principles 
  • Strong communication skills, including translating business needs into technical solutions and influencing without direct authority 
  • Experience using AI-assisted development tools in daily work, with a disciplined approach to reviewing generated code 

PREFERRED:  

  • Databricks or Azure certification 
  • Experience migrating legacy orchestration or ETL to Databricks 
  • Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads 
  • Experience with event-driven API patterns such as webhooks, asynchronous messaging, and event-carried state transfer 
  • Experience supporting machine learning workloads or MLOps practices, including real-time or near-real-time feature pipelines 
  • Retail, advertising technology, or retail media domain experience 

#LI-SSS

Pay Transparency and Benefits

  • The stated salary range represents the entire span applicable across all geographic markets from lowest to highest.  Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job-related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.
  • Below is a list of some of the benefits we offer our associates:
    • Health: Medical: with competitive plan designs and support for self-care, wellness and mental health. Dental: with in-network and out-of-network benefit. Vision: with in-network and out-of-network benefit.
    • Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.
    • Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company-paid holidays per year. Paid leave for maternity, paternity and family care instances.

 

Base Pay Range
$125,000—$207,000 USD

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 860, the most 1,353, and the latest week had 1,020.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Base Pay Range $125,000—$207,000 USD
Location & working pattern

Cincinnati, OH; Chicago, IL

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.