Pay
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Atlanta, GA, US, 30308
Live, first seen by us 65 days agoSet technical direction for the lakehouse, ingestion, and transformation patterns
Remove technical blockers so the team can keep delivering
Design and develop enterprise data models across domains
Build pipelines that clean, transform, and aggregate data from disparate sources
Lead engineers in building pipelines for high-velocity real-time and batch data
Lead the definition of data architecture in partnership with the team and stakeholders, setting technical direction for the lakehouse, ingestion, and transformation patterns.
Identify, escalate, and remove technical blockers for the team
Lead the design and development of enterprise data models (conceptual, logical, and physical) across domains
Build data pipelines that clean, transform, and aggregate data from disparate sources.
Lead Data Engineering team to use state-of-the-art Big Data tools and technologies to build scalable data architecture and performant data pipelines to acquire high-velocity real-time and batch data of different sizes and scales
Education Required Bachelor’s Degree, preferably in Information Systems, Computer Science, Computer Information Systems or related technology field. Skills Required • Databricks Lakehouse Expertise (Required): 10+ years in data engineering with deep, hands-on experience across the Databricks ecosystem including Spark/PySpark pipelines, Delta Lake (merges, schema evolution), Delta Live Tables, Unity Catalog governance, Genie for self-service analytics, and LakeFlow Designer for visual ETL orchestration. • Streaming & Cloud Infrastructure: 4+ years building reliable batch/streaming Spark workloads, 3+ years with Kafka (or Confluent) for high-volume event processing, and 3+ years working with AWS analytics services (S3, IAM, Glue/Lambda/MSK). • Data Modeling & SQL: Proven ability to design conceptual, logical, and physical data models with strong governance practices, paired with advanced SQL skills for building reliable, business-ready datasets. • Technical Leadership: Track record of leading technical design, mentoring engineers, driving architectural consensus, and unblocking teams on complex data engineering challenges. • Delivery & Collaboration: Experience delivering ETL/ELT pipelines end-to-end in a lakehouse environment, working within Agile frameworks (Scrum/Kanban/SAFe) to manage iterative delivery and cross-team dependencies.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 65
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Skills Required • Databricks Lakehouse Expertise (Required): 10+ years in data engineering with deep, hands-on experience across the Databricks ecosystem including Spark/PySpark pipelines, Delta Lake (merges, schema evolution), Delta Live Tables, Unity Catalog governance, Genie for self-service analytics, and LakeFlow Designer for visual ETL orchestration. • Streaming & Cloud Infrastructure: 4+ years building reliable batch/streaming Spark workloads, 3+ years with Kafka (or Confluent) for high-volume event processing, and 3+ years working with AWS analytics services (S3, IAM, Glue/Lambda/MSK). • Data Modeling & SQL: Proven ability to design conceptual, logical, and physical data models with strong governance practices, paired with advanced SQL skills for building reliable, business-ready datasets. • Technical Leadership: Track record of leading technical design, mentoring engineers, driving architectural consensus, and unblocking teams on complex data engineering challenges. • Delivery & Collaboration: Experience delivering ETL/ELT pipelines end-to-end in a lakehouse environment, working within Agile frameworks (Scrum/Kanban/SAFe) to manage iterative delivery and cross-team dependencies. Skills Desired • Prior experience as a technical lead, staff engineer, or similar role with formal responsibility for architecture decisions and team unblocking. • Python (and/or Scala) and PySpark/Scala-Spark. • Database solutions like Snowflake, Delta Lake or BigQuery. • NoSQL databases, including HBASE and/or Cassandra. • Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue. • Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series. • Strong understanding of Relational & Dimensional modeling. • Experience with GIT code versioning software. • Experience with REST API and Web Services. Work Conditions Location: Atlanta, GA Environment: Hybrid (two days in office; three days remote) Shift Work: No On-Call: Yes Weekend Work: No
Bachelor’s Degree, preferably in Information Systems, Computer Science, Computer Information Systems or related technology field. Skills Required • Databricks Lakehouse Expertise (Required): 10+ years in data engineering with deep, hands-on experience across the Databricks ecosystem including Spark/PySpark pipelines, Delta Lake (merges, schema evolution), Delta Live Tables, Unity Catalog governance, Genie for self-service analytics, and LakeFlow Designer for visual ETL orchestration. • Streaming & Cloud Infrastructure: 4+ years building reliable batch/streaming Spark workloads, 3+ years with Kafka (or Confluent) for high-volume event processing, and 3+ years working with AWS analytics services (S3, IAM, Glue/Lambda/MSK). • Data Modeling & SQL: Proven ability to design conceptual, logical, and physical data models with strong governance practices, paired with advanced SQL skills for building reliable, business-ready datasets. • Technical Leadership: Track record of leading technical design, mentoring engineers, driving architectural consensus, and unblocking teams on complex data engineering challenges. • Delivery & Collaboration: Experience delivering ETL/ELT pipelines end-to-end in a lakehouse environment, working within Agile frameworks (Scrum/Kanban/SAFe) to manage iterative delivery and cross-team dependencies. Skills Desired • Prior experience as a technical lead, staff engineer, or similar role with formal responsibility for architecture decisions and team unblocking. • Python (and/or Scala) and PySpark/Scala-Spark. • Database solutions like Snowflake, Delta Lake or BigQuery. • NoSQL databases, including HBASE and/or Cassandra. • Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue. • Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series. • Strong understanding of Relational & Dimensional modeling. • Experience with GIT code versioning software. • Experience with REST API and Web Services.
Requisition 40310: B5 Lead Data Engineer (Databricks, Big Data) A resume helps you stand out to hiring managers and recruiters; your resume communicates your experience and your brand. While it is not required, we encourage you to include an up-to-date resume along with a completed job application to give you the best opportunity to be considered. A complete resume helps us to better understand your unique background, relevant experiences, and passions. We look forward to learning about you.
Job Description Norfolk Southern Corporation is seeking a Lead Data Engineer who enjoys collaborating across the organization to deliver reliable, scalable data solutions. Join a skilled team focused on modern data platforms, where you will lead the definition of architecture, help shape and operate our Databricks-based lakehouse and streaming analytics capabilities, and guide the team through technical delivery. This role blends strong business and analytical judgment with hands-on engineering and technical leadership: you will partner with stakeholders and the engineering team to understand problems, translate them into clear requirements, define and drive pragmatic architectures, and deliver production-grade ingestion and transformation pipelines - with ownership through deployment and steady-state operations. You will also work closely with the team to proactively identify and remove technical blockers that stand in the way of delivery.
Complete your application on jobs.nscorp.com. The employer’s form will show what is required.
Already applied? Track this application
Requisition 40310: B5 Lead Data Engineer (Databricks, Big Data)
A resume helps you stand out to hiring managers and recruiters; your resume communicates your experience and your brand. While it is not required, we encourage you to include an up-to-date resume along with a completed job application to give you the best opportunity to be considered. A complete resume helps us to better understand your unique background, relevant experiences, and passions. We look forward to learning about you.
Norfolk Southern offers a unique opportunity to be part of our proud legacy that spans nearly 200 years. We are a customer-centric, operations-driven team dedicated to advancing safety, serving communities, and driving innovation for tomorrow's rail. As part of Norfolk Southern, you’ll join a collaborative team where there are opportunities for growth across the organization. We are building a culture where everyone can thrive by owning and driving exceptional results, being humble and leading with trust, serving our customers with excellence, and collaborating and coaching to win.
Norfolk Southern Corporation is seeking a Lead Data Engineer who enjoys collaborating across the organization to deliver reliable, scalable data solutions. Join a skilled team focused on modern data platforms, where you will lead the definition of architecture, help shape and operate our Databricks-based lakehouse and streaming analytics capabilities, and guide the team through technical delivery.
This role blends strong business and analytical judgment with hands-on engineering and technical leadership: you will partner with stakeholders and the engineering team to understand problems, translate them into clear requirements, define and drive pragmatic architectures, and deliver production-grade ingestion and transformation pipelines - with ownership through deployment and steady-state operations. You will also work closely with the team to proactively identify and remove technical blockers that stand in the way of delivery.
In this role, you will work with teams across the company to clarify Data and Analytics needs, perform structured requirements discovery alongside Data Modelers, align with BI development on scope and estimates, and lead and guide delivery through completion while promoting engineering quality, consistency, and best practices across the team.
• Lead the definition of data architecture in partnership with the team and stakeholders, setting technical direction for the lakehouse, ingestion, and transformation patterns.
• Identify, escalate, and remove technical blockers for the team - unblocking delivery through hands-on problem solving, design decisions, or coordination with other teams.
• Lead the design and development of enterprise data models (conceptual, logical, and physical) across domains, ensuring they align with lakehouse and pipeline architecture.
• Define and enforce data modeling standards, best practices, and governance processes, leveraging tools such as Erwin.
• Define data requirements, gather, and wrangle large scale of structured and unstructured data, and validate data by running various data tools in the Data Environment.
• Support the standardization, customization and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize and clean data.
• Create data policy and develop interfaces and retention models which require synthesizing or anonymizing data.
• Implement statistical data quality procedures on new data sources, and by applying rigorous iterative data analytics, supports Data Scientists and analytics and insights creation in data sourcing and preparation to visualize data and synthesize insights of commercial value.
• Develops and maintains data engineering best practices and contributes to Insights on data analytics and visualization concepts, methods and techniques.
• Lead Data Engineering team to use state-of-the-art Big Data tools and technologies to build scalable data architecture and performant data pipelines to acquire high-velocity real-time and batch data of different sizes and scales
• Work closely with the data science and business intelligence teams to develop data models and pipelines for research, reporting, and machine learning.
• Build data pipelines that clean, transform, and aggregate data from disparate sources.
• Employ a variety of languages and tools (e.g. scripting languages) to marry systems together.
• Apply knowledge of Data Architecture components, leads project teams from requirements to implementation.
Bachelor’s Degree, preferably in Information Systems, Computer Science, Computer Information Systems or related technology field.
Skills Required
• Databricks Lakehouse Expertise (Required): 10+ years in data engineering with deep, hands-on experience across the Databricks ecosystem including Spark/PySpark pipelines, Delta Lake (merges, schema evolution), Delta Live Tables, Unity Catalog governance, Genie for self-service analytics, and LakeFlow Designer for visual ETL orchestration.
• Streaming & Cloud Infrastructure: 4+ years building reliable batch/streaming Spark workloads, 3+ years with Kafka (or Confluent) for high-volume event processing, and 3+ years working with AWS analytics services (S3, IAM, Glue/Lambda/MSK).
• Data Modeling & SQL: Proven ability to design conceptual, logical, and physical data models with strong governance practices, paired with advanced SQL skills for building reliable, business-ready datasets.
• Technical Leadership: Track record of leading technical design, mentoring engineers, driving architectural consensus, and unblocking teams on complex data engineering challenges.
• Delivery & Collaboration: Experience delivering ETL/ELT pipelines end-to-end in a lakehouse environment, working within Agile frameworks (Scrum/Kanban/SAFe) to manage iterative delivery and cross-team dependencies.
Skills Desired
• Prior experience as a technical lead, staff engineer, or similar role with formal responsibility for architecture decisions and team unblocking.
• Python (and/or Scala) and PySpark/Scala-Spark.
• Database solutions like Snowflake, Delta Lake or BigQuery.
• NoSQL databases, including HBASE and/or Cassandra.
• Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue.
• Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series.
• Strong understanding of Relational & Dimensional modeling.
• Experience with GIT code versioning software.
• Experience with REST API and Web Services.
Work Conditions
Location: Atlanta, GA
Environment: Hybrid (two days in office; three days remote)
Shift Work: No
On-Call: Yes
Weekend Work: No
Company Overview
Since 1827, Norfolk Southern Corporation (NYSE: NSC) and its predecessor companies have safely moved the goods and materials that drive the U.S. economy. Today, it operates a customer-centric and operations-driven freight transportation network. Committed to furthering sustainability, Norfolk Southern helps its customers avoid 15 million tons of yearly carbon emissions by shipping via rail. Its dedicated team members deliver more than 7 million carloads annually, from agriculture to consumer goods, and is the largest rail shipper of auto products and metals in North America. Norfolk Southern also has the most extensive intermodal network in the eastern U.S., serving a majority of the country’s population and manufacturing base, with connections to every major container port on the Atlantic coast as well as the Gulf of Mexico and Great Lakes. Learn more by visiting www.NorfolkSouthern.com.
At Norfolk Southern, we believe in celebrating our individuality. By leveraging the unique backgrounds and viewpoints of our employees, we can create a culture of innovation, respect, and inclusion. We know that employees thrive in a workplace where differing viewpoints, ideas, and experiences are freely shared and valued. As such, we encourage all employees to contribute their distinctive skills and capabilities to our organization.
Equal employment opportunities are available to all applicants regardless of race, color, religion, age, sex, national origin, disability status, genetic information, veteran status, sexual orientation, and gender identity. Together, we power progress.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Atlanta, GA, US, 30308
Skills Desired • Prior experience as a technical lead, staff engineer, or similar role with formal responsibility for architecture decisions and team unblocking. • Python (and/or Scala) and PySpark/Scala-Spark. • Database solutions like Snowflake, Delta Lake or BigQuery. • NoSQL databases, including HBASE and/or Cassandra. • Azure, AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and Glue. • Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ Series. • Strong understanding of Relational & Dimensional modeling. • Experience with GIT code versioning software. • Experience with REST API and Web Services. Work Conditions Location: Atlanta, GA Environment: Hybrid (two days in office; three days remote) Shift Work: No On-Call: Yes Weekend Work: No Company Overview
No clear work-authorization passage found. Eligibility is unconfirmed.