Back to jobs

Data Engineering - Lead

Pay
$130,000–150,000/year — pay source
Job ID:26-22310 Pay Range: $130000 - $150000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Data Strategy & Architecture Define and drive the enterprise data engineering strategy and roadmap.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Define the enterprise data engineering strategy and roadmap

  • Lead modernization from legacy data environments to cloud-native platforms

  • Build and maintain batch, streaming, and event-driven data pipelines

  • Lead and mentor a team of data engineers, architects and integration specialists

  • Manage delivery of multiple concurrent data engineering initiatives

From the employer’s posting
Define and drive the enterprise data engineering strategy and roadmap.
Lead modernization efforts from legacy data environments to cloud-native data platforms.
Develop and maintain high-volume batch, streaming, and event-driven data pipelines.
Lead and mentor a team of Data Engineers, Data Architects, and Data Integration specialists.
Manage delivery of multiple concurrent data engineering initiatives.

Before you apply

Employer’s visa record
211 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
Key Requirements and Technology Experience: - Must have skills: - Data Architecture, Data Governance, Insurance - Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field. - Master's degree preferred.
Apply at Pyramid Consulting

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Jul 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$130K–$150K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Pyramid Consulting is hiring

56 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Scala
  • SQL
  • AWS
  • Azure
  • BigQuery
  • Databricks
  • Redshift
  • Snowflake
  • Spark
  • GCP
Where the posting names them
- SQL and advanced database technologies - Python, Spark, Scala, or similar data engineering technologies - ETL and ELT frameworks
- Strong experience in multiple areas including: - SQL and advanced database technologies - Python, Spark, Scala, or similar data engineering technologies
- Data Lakes, Lakehouse, and Data Warehouse architectures - Cloud platforms (Azure, AWS, or Google Cloud) - Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
- Cloud platforms (Azure, AWS, or Google Cloud) - Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies - Real-time data processing and streaming architectures

Your next step

Complete your application on jobs.sprockets.ai. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Immediate need for a talented Data Engineering - Lead. This is a Fulltime opportunity with long-term potential and is located in Charleston, SC (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:26-22310

Pay Range: $130000 - $150000/annum.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:
  • Data Strategy & Architecture
  • Define and drive the enterprise data engineering strategy and roadmap.
  • Design scalable data architectures supporting operational, analytical, and AI workloads.
  • Establish standards for data modeling, data integration, metadata management, and data lifecycle management.
  • Lead modernization efforts from legacy data environments to cloud-native data platforms.
  • Ensure alignment with enterprise architecture, cybersecurity, and compliance requirements.
  • Data Platform Engineering
  • Lead the design and implementation of enterprise data platforms utilizing cloud technologies and modern data architectures.
  • Develop and maintain high-volume batch, streaming, and event-driven data pipelines.
  • Build and manage data lakes, data warehouses, lakehouse architectures, and data products.
  • Establish reusable frameworks and accelerators that improve engineering velocity and solution consistency.
  • Drive platform automation through Infrastructure-as-Code and DataOps practices.
  • Leadership & Team Development
  • Lead and mentor a team of Data Engineers, Data Architects, and Data Integration specialists.
  • Establish engineering best practices and technical standards.
  • Provide technical oversight, architecture reviews, and design guidance across projects.
  • Foster a culture of innovation, accountability, continuous learning, and operational excellence.
  • Support recruitment, onboarding, career development, and performance management activities.
  • Data Governance & Quality
  • Implement enterprise data governance practices.
  • Establish data quality frameworks, monitoring, observability, and remediation processes.
  • Partner with data stewards and business stakeholders to improve trust in enterprise data assets.
  • Ensure compliance with regulatory, privacy, retention, and security requirements.
  • Define and monitor KPIs related to data quality, availability, and reliability.
  • AI & Advanced Analytics Enablement
  • Build and optimize data environments that support AI, machine learning, and advanced analytics initiatives.
  • Collaborate with data scientists and AI teams to operationalize models and data products.
  • Support enterprise AI initiatives through governed, trusted, high-quality data pipelines.
  • Establish patterns for feature engineering, model data preparation, and data consumption.
  • Delivery & Execution
  • Manage delivery of multiple concurrent data engineering initiatives.
  • Create project plans, estimates, resource forecasts, and delivery commitments.
  • Drive agile delivery practices while maintaining governance and quality expectations.
  • Identify risks, dependencies, technical debt, and remediation plans.
  • Ensure predictable delivery, operational stability, and stakeholder satisfaction.
  • Stakeholder Engagement
  • Work closely with executive leadership to align data investments with business objectives.
  • Partner with engineering, product management, operations, and business teams to prioritize initiatives.
  • Present technical recommendations, investment strategies, and progress updates to leadership audiences.
  • Act as a trusted advisor for enterprise data strategy and modernization initiatives.
Key Requirements and Technology Experience:
  • Must have skills: - Data Architecture, Data Governance, Insurance
  • Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field.
  • Master's degree preferred.
  • 10+ years of experience in Data Engineering, Data Architecture, or related technology disciplines.
  • 3+ years leading technical teams or enterprise-scale data initiatives.
  • Demonstrated experience designing and delivering enterprise data platforms.
  • Experience leading cross-functional teams in global delivery environments.
  • Technical Expertise
  • Strong experience in multiple areas including:
  • SQL and advanced database technologies
  • Python, Spark, Scala, or similar data engineering technologies
  • ETL and ELT frameworks
  • Data Lakes, Lakehouse, and Data Warehouse architectures
  • Cloud platforms (Azure, AWS, or Google Cloud)
  • Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
  • Real-time data processing and streaming architectures
  • API-based integration and event-driven architectures
  • CI/CD, DataOps, Infrastructure-as-Code, and automation practices
  • Insurance industry experience.
  • Experience supporting AI, Machine Learning, and Generative AI initiatives.
  • Experience implementing enterprise data governance programs.
  • Success leading large-scale cloud migration or data modernization programs.
  • Experience with observability, operational monitoring, and reliability engineering.
  • Leadership Competencies
  • Strategic Thinking
  • Technical Leadership
  • Decision Making
  • Stakeholder Management
  • Talent Development
  • Executive Communication
  • Continuous Improvement Mindset
  • Customer Focus
  • Results Orientation
  • Cross-Functional Collaboration
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar fulltime positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Job ID:26-22310 Pay Range: $130000 - $150000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Data Strategy & Architecture Define and drive the enterprise data engineering strategy and roadmap.
Location & working pattern

Charleston, SC, US

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.