Back to jobs

Lead Digital Data Engineer (Databricks)

BJ's Club Support Center Marlborough, MA #5997

Live, first seen by us 24 days ago
Pay
$128,500–164,000/yearAnnual period assumed. Location-specific pay — pay source
This is a hybrid role. Tuesday through Thursday are in-office days at BJ's Club Support Center in Marlborough, MA and Monday and Friday are remote days. In accordance with the Pay Transparency requirements, the following represents a good faith estimate of the compensation range for this position. At BJ’s Wholesale Club, we carefully consider a wide range of non-discriminatory factors when determining salary. Actual salaries will vary depending on factors including but not limited to location, education, experience, and qualifications. The pay range for this position is $128,500.00 - $164,000.00 We recognize the growing role of AI tools, including ChatGPT, and value familiarity with them. That said, we want to hear from your authentic self. Your application should reflect your own skills, experiences, and insights rather than AI-generated responses.
Read the full posting
Work setting
Hybrid — work setting source
SDLC, CI/CD, version control, and test automation for data pipelines This is a hybrid role. Tuesday through Thursday are in-office days at BJ's Club Support Center in Marlborough, MA and Monday and Friday are remote days. In accordance with the Pay Transparency requirements, the following represents a good faith estimate of the compensation range for this position. At BJ’s Wholesale Club, we carefully consider a wide range of non-discriminatory factors when determining salary. Actual salaries will vary depending on factors including but not limited to location, education, experience, and qualifications. The pay range for this position is $128,500.00 - $164,000.00
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Design and maintain a scalable Delta Lake medallion Lakehouse as the analytics source of truth

  • Build batch and real-time pipelines from AWS services into Databricks

  • Build Genie Spaces, AI/BI dashboards and Databricks agents for business self-service

  • Lead data governance and data quality checks through Unity Catalog

  • Lead and mentor a distributed team of up to 10 engineers, onshore and offshore

From the employer’s posting
Design and maintain a scalable Lakehouse using Delta Lake and the medallion (Bronze/Silver/Gold) architecture
Build batch and real-time pipelines integrating Kafka, DynamoDB, S3, and other AWS services with Databricks
Design reusable Genie Spaces and AI/BI dashboards with certified metrics for business self-service.
Lead data governance through Unity Catalog (access control, lineage, classification)
Lead and mentor a distributed team of up to 10 engineers across onshore and offshore locations

Before you apply

Employer’s visa record
43 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Apply at BJ's Wholesale Club

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 28, 202624 days ago
Recorded sightings
20
Last seen by us
Nov 15, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$129K–$164K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 24

Similar jobs usually come down between day 6 and day 56.

From 14,766 similar postings that came down. Coming down is not always a hire.

BJ's Wholesale Club is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • SQL
  • AWS
  • Azure
  • Databricks
  • Delta Lake
  • DynamoDB
  • GCP
  • Kafka
  • MLflow
  • Redshift
  • S3
  • Spark
  • Terraform
  • PySpark
Where the posting names them
- Develop and productionize Databricks agents and AI use cases using Mosaic AI, MLflow, Model Serving, and Vector Search. - Optimize performance and cost across clusters, SQL Warehouses, and Delta tables. - Establish CI/CD for data pipelines (Databricks Asset Bundles, Git workflows, automated testing, Terraform).
Minimum Requirements Bachelor's degree in Computer Science, Information Technology, or equivalent, plus 7+ years of experience in data engineering, including 3+ years of hands-on Databricks experience in production. Experience must include: - Expert-level Apache Spark (PySpark and SQL), Delta Lake, and Lakehouse architecture - Unity Catalog, Databricks Workflows, and SQL Warehouses
- Expert-level Apache Spark (PySpark and SQL), Delta Lake, and Lakehouse architecture - Unity Catalog, Databricks Workflows, and SQL Warehouses - Integrating AWS services: S3, Kafka (MSK/Confluent), DynamoDB, Lambda, and IAM
Role Summary As Lead Digital Data Engineer, you will own the design, build, and evolution of BJ's Databricks Lakehouse, working closely with product managers, program managers, and business unit heads. You will turn digital, fulfillment, and operational data into trusted, governed, self-service data products, and lead our adoption of AI-powered analytics, including Genie and Databricks agents. Key Responsibilities - Design and maintain a scalable Lakehouse using Delta Lake and the medallion (Bronze/Silver/Gold) architecture, serving as the single source of truth for analytics following the migration from AWS Redshift. - Build batch and real-time pipelines integrating Kafka, DynamoDB, S3, and other AWS services with Databricks (Structured Streaming, Auto Loader, Delta Live Tables).
- Design and maintain a scalable Lakehouse using Delta Lake and the medallion (Bronze/Silver/Gold) architecture, serving as the single source of truth for analytics following the migration from AWS Redshift. - Build batch and real-time pipelines integrating Kafka, DynamoDB, S3, and other AWS services with Databricks (Structured Streaming, Auto Loader, Delta Live Tables). - Ingest and integrate digital sources such as Adobe Analytics, AEP, and Google Analytics alongside transactional and operational data.
- Unity Catalog, Databricks Workflows, and SQL Warehouses - Integrating AWS services: S3, Kafka (MSK/Confluent), DynamoDB, Lambda, and IAM - Building data quality and validation frameworks
- Genie Spaces, AI/BI dashboards, and building Databricks agents or GenAI solutions (Mosaic AI, MLflow) - Building large-scale distributed data systems on AWS, Azure, or GCP - Working in an Agile Scrum environment and leading distributed teams
*Eligibility requirements vary by position. Role Summary As Lead Digital Data Engineer, you will own the design, build, and evolution of BJ's Databricks Lakehouse, working closely with product managers, program managers, and business unit heads. You will turn digital, fulfillment, and operational data into trusted, governed, self-service data products, and lead our adoption of AI-powered analytics, including Genie and Databricks agents. Key Responsibilities - Design and maintain a scalable Lakehouse using Delta Lake and the medallion (Bronze/Silver/Gold) architecture, serving as the single source of truth for analytics following the migration from AWS Redshift.
- Design reusable Genie Spaces and AI/BI dashboards with certified metrics for business self-service. - Develop and productionize Databricks agents and AI use cases using Mosaic AI, MLflow, Model Serving, and Vector Search. - Optimize performance and cost across clusters, SQL Warehouses, and Delta tables.
- Optimize performance and cost across clusters, SQL Warehouses, and Delta tables. - Establish CI/CD for data pipelines (Databricks Asset Bundles, Git workflows, automated testing, Terraform). - Own and prioritize the digital data and analytics roadmap with product leaders.
- Lead and mentor a distributed team of up to 10 engineers across onshore and offshore locations, driving Agile delivery and providing regular status and risk updates to senior leadership. Minimum Requirements Bachelor's degree in Computer Science, Information Technology, or equivalent, plus 7+ years of experience in data engineering, including 3+ years of hands-on Databricks experience in production. Experience must include: - Expert-level Apache Spark (PySpark and SQL), Delta Lake, and Lakehouse architecture
- Building data quality and validation frameworks - Genie Spaces, AI/BI dashboards, and building Databricks agents or GenAI solutions (Mosaic AI, MLflow) - Building large-scale distributed data systems on AWS, Azure, or GCP

Your next step

Complete your application on bjswholesaleclub.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

A World-Class Team


BJ’s Wholesale Club is powered by more than 30,000 team members who make a real impact every day. Whether you're stocking shelves, solving problems or shaping strategy, your work helps families save on what matters most.


We’re a team built on purpose and opportunity. Join us and be part of something meaningful.


Why You’ll Love Working at BJ’s

At BJ’s Wholesale Club, our team members are at the heart of everything we do. That’s why we offer a comprehensive benefits package designed to support your health, well-being and future – both on and off the job. When you grow, we grow.


Here’s just some of what you can look forward to:

  • Weekly Pay: Get paid every week so that you can manage your money on your terms.
  • Daily Pay: Access your earned pay before payday, giving you more flexibility when you need it. (fee may apply.)
  • Free BJ’s Memberships: Enjoy a complimentary The Club Card Membership, plus a free Supplemental Membership for someone in your household.*
  • Generous Paid Time Off: Take the time you need with vacation, personal, sick days, holidays, bereavement, and jury duty leave.*
  • Flexible and Affordable Health Benefits: Choose from three medical plans, and access optional dental, vision, Health Savings Account (HSA), and flexible spending account options to fit your lifestyle.*
  • 401(k) Retirement Savings Plan: Build your financial future with a company match (available to team members 18 and older).*
  • Employee Stock Purchase Plan:  Accumulate funds through after-tax payroll deductions that can be used to purchase shares of BJ’s common stock at a 15% discount.*

*Eligibility requirements vary by position.

Role Summary
As Lead Digital Data Engineer, you will own the design, build, and evolution of BJ's Databricks Lakehouse, working closely with product managers, program managers, and business unit heads. You will turn digital, fulfillment, and operational data into trusted, governed, self-service data products, and lead our adoption of AI-powered analytics, including Genie and Databricks agents.
Key Responsibilities

  • Design and maintain a scalable Lakehouse using Delta Lake and the medallion (Bronze/Silver/Gold) architecture, serving as the single source of truth for analytics following the migration from AWS Redshift.
  • Build batch and real-time pipelines integrating Kafka, DynamoDB, S3, and other AWS services with Databricks (Structured Streaming, Auto Loader, Delta Live Tables).
  • Ingest and integrate digital sources such as Adobe Analytics, AEP, and Google Analytics alongside transactional and operational data.
  • Implement data quality validation frameworks with automated checks, alerting, and SLAs so data is accurate and clearly represented across business verticals.
  • Lead data governance through Unity Catalog (access control, lineage, classification) and monitor pipeline health, freshness, and cost.
  • Design reusable Genie Spaces and AI/BI dashboards with certified metrics for business self-service.
  • Develop and productionize Databricks agents and AI use cases using Mosaic AI, MLflow, Model Serving, and Vector Search.
  • Optimize performance and cost across clusters, SQL Warehouses, and Delta tables.
  • Establish CI/CD for data pipelines (Databricks Asset Bundles, Git workflows, automated testing, Terraform).
  • Own and prioritize the digital data and analytics roadmap with product leaders.
  • Lead and mentor a distributed team of up to 10 engineers across onshore and offshore locations, driving Agile delivery and providing regular status and risk updates to senior leadership.

Minimum Requirements
Bachelor's degree in Computer Science, Information Technology, or equivalent, plus 7+ years of experience in data engineering, including 3+ years of hands-on Databricks experience in production. Experience must include:

  • Expert-level Apache Spark (PySpark and SQL), Delta Lake, and Lakehouse architecture
  • Unity Catalog, Databricks Workflows, and SQL Warehouses
  • Integrating AWS services: S3, Kafka (MSK/Confluent), DynamoDB, Lambda, and IAM
  • Building data quality and validation frameworks
  • Genie Spaces, AI/BI dashboards, and building Databricks agents or GenAI solutions (Mosaic AI, MLflow)
  • Building large-scale distributed data systems on AWS, Azure, or GCP
  • Working in an Agile Scrum environment and leading distributed teams
  • SDLC, CI/CD, version control, and test automation for data pipelines

This is a hybrid role. Tuesday through Thursday are in-office days at BJ's Club Support Center in Marlborough, MA and Monday and Friday are remote days.

In accordance with the Pay Transparency requirements, the following represents a good faith estimate of the compensation range for this position. At BJ’s Wholesale Club, we carefully consider a wide range of non-discriminatory factors when determining salary. Actual salaries will vary depending on factors including but not limited to location, education, experience, and qualifications. The pay range for this position is $128,500.00 - $164,000.00

 

 

We recognize the growing role of AI tools, including ChatGPT, and value familiarity with them. That said, we want to hear from your authentic self. Your application should reflect your own skills, experiences, and insights rather than AI-generated responses.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
This is a hybrid role. Tuesday through Thursday are in-office days at BJ's Club Support Center in Marlborough, MA and Monday and Friday are remote days. In accordance with the Pay Transparency requirements, the following represents a good faith estimate of the compensation range for this position. At BJ’s Wholesale Club, we carefully consider a wide range of non-discriminatory factors when determining salary. Actual salaries will vary depending on factors including but not limited to location, education, experience, and qualifications. The pay range for this position is $128,500.00 - $164,000.00 We recognize the growing role of AI tools, including ChatGPT, and value familiarity with them. That said, we want to hear from your authentic self. Your application should reflect your own skills, experiences, and insights rather than AI-generated responses.
Location & working pattern

BJ's Club Support Center Marlborough, MA #5997

- SDLC, CI/CD, version control, and test automation for data pipelines This is a hybrid role. Tuesday through Thursday are in-office days at BJ's Club Support Center in Marlborough, MA and Monday and Friday are remote days. In accordance with the Pay Transparency requirements, the following represents a good faith estimate of the compensation range for this position. At BJ’s Wholesale Club, we carefully consider a wide range of non-discriminatory factors when determining salary. Actual salaries will vary depending on factors including but not limited to location, education, experience, and qualifications. The pay range for this position is $128,500.00 - $164,000.00
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.