Job ID:26-22310
Pay Range: $130000 - $150000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Data Strategy & Architecture
Define and drive the enterprise data engineering strategy and roadmap.
Define the enterprise data engineering strategy and roadmap
Lead modernization from legacy data environments to cloud-native platforms
Build and maintain batch, streaming, and event-driven data pipelines
Lead and mentor a team of data engineers, architects and integration specialists
Manage delivery of multiple concurrent data engineering initiatives
From the employer’s posting
Define and drive the enterprise data engineering strategy and roadmap.
Lead modernization efforts from legacy data environments to cloud-native data platforms.
Develop and maintain high-volume batch, streaming, and event-driven data pipelines.
Lead and mentor a team of Data Engineers, Data Architects, and Data Integration specialists.
Manage delivery of multiple concurrent data engineering initiatives.
Before you apply
Employer’s visa record
211 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
Key Requirements and Technology Experience: - Must have skills: - Data Architecture, Data Governance, Insurance
- Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field.
- Master's degree preferred.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
Scala
SQL
AWS
Azure
BigQuery
Databricks
Redshift
Snowflake
Spark
GCP
Where the posting names them
- SQL and advanced database technologies
- Python, Spark, Scala, or similar data engineering technologies
- ETL and ELT frameworks
- Strong experience in multiple areas including:
- SQL and advanced database technologies
- Python, Spark, Scala, or similar data engineering technologies
- Data Lakes, Lakehouse, and Data Warehouse architectures
- Cloud platforms (Azure, AWS, or Google Cloud)
- Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
- Cloud platforms (Azure, AWS, or Google Cloud)
- Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
- Real-time data processing and streaming architectures
Immediate need for a talented Data Engineering - Lead. This is a Fulltime opportunity with long-term potential and is located in Charleston, SC (Onsite). Please review the job description below and contact me ASAP if you are interested.
Job ID:26-22310
Pay Range: $130000 - $150000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
Key Responsibilities:
Data Strategy & Architecture
Define and drive the enterprise data engineering strategy and roadmap.
Design scalable data architectures supporting operational, analytical, and AI workloads.
Establish standards for data modeling, data integration, metadata management, and data lifecycle management.
Lead modernization efforts from legacy data environments to cloud-native data platforms.
Ensure alignment with enterprise architecture, cybersecurity, and compliance requirements.
Data Platform Engineering
Lead the design and implementation of enterprise data platforms utilizing cloud technologies and modern data architectures.
Develop and maintain high-volume batch, streaming, and event-driven data pipelines.
Build and manage data lakes, data warehouses, lakehouse architectures, and data products.
Establish reusable frameworks and accelerators that improve engineering velocity and solution consistency.
Drive platform automation through Infrastructure-as-Code and DataOps practices.
Leadership & Team Development
Lead and mentor a team of Data Engineers, Data Architects, and Data Integration specialists.
Establish engineering best practices and technical standards.
Provide technical oversight, architecture reviews, and design guidance across projects.
Foster a culture of innovation, accountability, continuous learning, and operational excellence.
Support recruitment, onboarding, career development, and performance management activities.
Data Governance & Quality
Implement enterprise data governance practices.
Establish data quality frameworks, monitoring, observability, and remediation processes.
Partner with data stewards and business stakeholders to improve trust in enterprise data assets.
Ensure compliance with regulatory, privacy, retention, and security requirements.
Define and monitor KPIs related to data quality, availability, and reliability.
AI & Advanced Analytics Enablement
Build and optimize data environments that support AI, machine learning, and advanced analytics initiatives.
Collaborate with data scientists and AI teams to operationalize models and data products.
Support enterprise AI initiatives through governed, trusted, high-quality data pipelines.
Establish patterns for feature engineering, model data preparation, and data consumption.
Delivery & Execution
Manage delivery of multiple concurrent data engineering initiatives.
Create project plans, estimates, resource forecasts, and delivery commitments.
Drive agile delivery practices while maintaining governance and quality expectations.
Identify risks, dependencies, technical debt, and remediation plans.
Ensure predictable delivery, operational stability, and stakeholder satisfaction.
Stakeholder Engagement
Work closely with executive leadership to align data investments with business objectives.
Partner with engineering, product management, operations, and business teams to prioritize initiatives.
Present technical recommendations, investment strategies, and progress updates to leadership audiences.
Act as a trusted advisor for enterprise data strategy and modernization initiatives.
Key Requirements and Technology Experience:
Must have skills: - Data Architecture, Data Governance, Insurance
Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or related field.
Master's degree preferred.
10+ years of experience in Data Engineering, Data Architecture, or related technology disciplines.
3+ years leading technical teams or enterprise-scale data initiatives.
Demonstrated experience designing and delivering enterprise data platforms.
Experience leading cross-functional teams in global delivery environments.
Technical Expertise
Strong experience in multiple areas including:
SQL and advanced database technologies
Python, Spark, Scala, or similar data engineering technologies
ETL and ELT frameworks
Data Lakes, Lakehouse, and Data Warehouse architectures
Cloud platforms (Azure, AWS, or Google Cloud)
Databricks, Snowflake, Synapse, Redshift, BigQuery, or equivalent technologies
Real-time data processing and streaming architectures
API-based integration and event-driven architectures
CI/CD, DataOps, Infrastructure-as-Code, and automation practices
Insurance industry experience.
Experience supporting AI, Machine Learning, and Generative AI initiatives.
Experience implementing enterprise data governance programs.
Success leading large-scale cloud migration or data modernization programs.
Experience with observability, operational monitoring, and reliability engineering.
Leadership Competencies
Strategic Thinking
Technical Leadership
Decision Making
Stakeholder Management
Talent Development
Executive Communication
Continuous Improvement Mindset
Customer Focus
Results Orientation
Cross-Functional Collaboration
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar fulltime positions. If you are interested in this position, please apply online for immediate consideration.
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Pay
Job ID:26-22310
Pay Range: $130000 - $150000/annum. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Data Strategy & Architecture
Define and drive the enterprise data engineering strategy and roadmap.
Location & working pattern
Charleston, SC, US
Working pattern and location restrictions need checking in the full posting.
Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.