Pay
In line with similar jobs
$125K–$207K against $127K–$190K, the middle half of what similar US postings state.
From 2,396 postings in the last year. Stated ranges, not salaries paid.
Cincinnati, OH; Chicago, IL
Actively hiring, first seen by us 19 hours agoBase Pay Range $125,000—$207,000 USDRead the full posting
Lead design and development of Databricks-based solutions and set engineering standards
Build streaming pipelines handling ordering, late data, duplicates, retries and replay
Design and build event-driven data solutions and define event schemas and contracts
Own operational health of pipelines, including incident response and root cause analysis
Provide day-to-day direction to a team of engineers
Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards
Build streaming pipelines that handle ordering, late-arriving data, duplicates, retries, dead-letter handling, and replay or backfill
Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers
Own operational health of the pipelines you build, including incident response, root cause analysis, and meeting service level expectations
Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore
QUALIFICATIONS, SKILLS, AND EXPERIENCE: - Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program, or equivalent experience - 5+ years of professional data engineering experience
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
In line with similar jobs
$125K–$207K against $127K–$190K, the middle half of what similar US postings state.
From 2,396 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
At 84.51°, jobs usually come down by about day 40.
From 14,168 similar postings that came down, and 11 of 84.51°’s. Coming down is not always a hire.
6 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Lead Data Engineer (P3999) SUMMARY: As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud, using both batch and event-driven patterns. Our engineers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, SQL and JSON to build products, tools, and features that power applications serving our commercial products. You will provide technical leadership to a blended onshore/offshore team and work closely with Product, Data Science, and technical architects. Communication and collaboration with these partners are critical to success in this role. RESPONSIBILITIES: Take ownership of features and drive them to completion through all phases of the 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
- 5+ years developing with Spark (Databricks, PySpark) - 5+ years developing with Python and SQL - 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams
- 2+ years of experience technically leading or mentoring engineers, including blended onshore/offshore or vendor teams - Experience building event-driven or streaming data solutions with Spark Structured Streaming and a messaging platform such as Kafka, Azure Service Bus, or similar - Solid understanding of event-driven architecture concepts, including publish/subscribe, event sourcing, change data capture, delivery guarantees (at-least-once, exactly-once), idempotent processing, windowing and watermarking, and handling of out-of-order and late-arriving events
- Experience with schema management for events (for example Avro, Protobuf, or JSON Schema with a schema registry) and backward-compatible schema evolution - Experience with Azure data services such as ADLS, Azure Key Vault, Azure Kubernetes Service, and Azure Data Factory - Experience with CI/CD, Git-based workflows, code review, and infrastructure as code
PREFERRED: - Databricks or Azure certification - Experience migrating legacy orchestration or ETL to Databricks
- Provide technical leadership and day-to-day direction to a team of engineers covering operations and development, blended onshore/offshore - Lead design and development of Databricks-based solutions, run design reviews, and set engineering standards in partnership with technical architects - Design and build event-driven data solutions, including streaming ingestion, event processing, and publishing data as events for downstream consumers
- 5+ years of professional data engineering experience - 5+ years developing with Spark (Databricks, PySpark) - 5+ years developing with Python and SQL
- Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution - Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control - Experience building REST APIs (1+ years) and working with Kubernetes (1+ years)
- Databricks or Azure certification - Experience migrating legacy orchestration or ETL to Databricks - Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads
- Experience migrating legacy orchestration or ETL to Databricks - Experience with Databricks Auto Loader and Delta Live Tables (Lakeflow Declarative Pipelines) for streaming workloads - Experience with event-driven API patterns such as webhooks, asynchronous messaging, and event-carried state transfer
- Experience with CI/CD, Git-based workflows, code review, and infrastructure as code - Strong data modeling skills, including dimensional modeling, layered (medallion) architecture, Delta Lake, and schema evolution - Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control
- Build and maintain CI/CD pipelines, infrastructure as code, and environment promotion practices - Develop REST APIs hosted in Kubernetes - Partner with Data Science to deliver the data and feature pipelines needed for model development and deployment
- Experience with Databricks Unity Catalog or equivalent technology, including data governance and access control - Experience building REST APIs (1+ years) and working with Kubernetes (1+ years) - Experience with production operations, including monitoring, on-call or incident response, and root cause analysis
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
84.51° Overview:
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.
84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.
Join us at 84.51°!
__________________________________________________________
Lead Data Engineer (P3999)
SUMMARY:
As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud, using both batch and event-driven patterns. Our engineers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, SQL and JSON to build products, tools, and features that power applications serving our commercial products. You will provide technical leadership to a blended onshore/offshore team and work closely with Product, Data Science, and technical architects. Communication and collaboration with these partners are critical to success in this role.
RESPONSIBILITIES:
Take ownership of features and drive them to completion through all phases of the 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:
QUALIFICATIONS, SKILLS, AND EXPERIENCE:
PREFERRED:
#LI-SSS
Pay Transparency and Benefits
New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Base Pay Range $125,000—$207,000 USD
Cincinnati, OH; Chicago, IL
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.