Back to jobs

Data Engineer Principal_3003

Minneapolis, Minnesota, United States

Live, first seen by us 73 days ago
Pay
$110,000–150,000/year · BaseLocation-specific pay — pay source
We believe in rewarding performance and our compensation and benefits package includes health insurance, company bonus scheme, 401(K) with company match, company paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, an employee shares program and employee discounts From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered. The annualized base pay range for this role is $110,000 - 150,000. The annual base salary range represents a nationwide market range. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role, and the skills, education, training, credentials and experience of the candidate. The base pay is just one component of the ATA total compensation package. As part of our comprehensive compensation and highly rated benefits programs, ATA also offers eligibility for an incentive-based annual bonus. About Allianz Technology
Read the full posting
Work setting
Not stated
Employment
Permanent — employment source
Employment type in the employer’s posting: Permanent
From the employer’s posting

What you’ll work on

Full posting
  • Reverse-engineer, document, and validate existing pipelines, data models, and controls

  • Identify and fix defects and technical debt in the existing platform

  • Migrate validated workloads to Databricks with output checks before cutover

  • Re-implement ingestion, transformation, and orchestration pipelines on target platforms

  • Mentor engineers, review code and designs, and plan legacy decommissioning

From the employer’s posting
Reverse-engineer, document, and validate existing pipeline logic, data models, transformation frameworks, and data governance controls
Identify gaps, defects, and technical debt across the platform and remediate where implementations are incorrect or sub-optimal
Support platform evolution initiatives, including parallel-run phases where multiple implementations operate simultaneously, validating output consistency before cutover
Re-implement ingestion, transformation, and orchestration pipelines on target platforms, maintaining audit, quality, and reconciliation standards
Mentor less experienced engineers, review code and designs, and support decommission planning for legacy components

Benefits in the posting

Full benefits wording
  • We believe in rewarding performance and our compensation and benefits package includes health insurance, company bonus scheme, 401(K) with company match, company paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, an employee shares program and employee discounts From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered.
  • The annualized base pay range for this role is $110,000 - 150,000. The annual base salary range represents a nationwide market range. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role, and the skills, education, training, credentials and experience of the candidate. The base pay is just one component of the ATA total compensation package. As part of our comprehensive compensation and highly rated benefits programs, ATA also offers eligibility for an incentive-based annual bonus.

From the employer’s posting.

About Allianz Insurance

Allianz Group is one of the most trusted insurance and asset management companies in the world.

In the employer’s words · Read in context

Apply at Allianz Insurance

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 5, 202673 days ago
Recorded sightings
144
Last seen by us
Nov 17, 2026
Employer says posted
Aug 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$110K–$150K against $127K–$190K, the middle half of what similar US postings state.

From 2,383 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 73

Up longer than most. Similar jobs usually come down between day 6 and day 56.

Well past Allianz Insurance’s usual: its jobs come down by about day 3.

From 13,974 similar postings that came down, and 427 of Allianz Insurance’s. Coming down is not always a hire.

Allianz Insurance is hiring

89 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring is steady
  • Takes jobs down quickly
  • 3% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Docker
  • Kafka
  • Oracle
  • Power BI
  • Spark
  • SQL Server
  • Tableau
  • Terraform
  • PySpark
Where the posting names them
Data Engineering & Development - Strong Python and SQL programming skills - Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models
- Azure Synapse & Data Platform Mandatory hands-on expertise with: - Azure Synapse Analytics (Pipelines, Spark Pool, Dedicated SQL Pool) - Azure Data Lake Storage Gen2 (ADLS Gen2)
- Strong knowledge of SCD Type 0/1/2, CDC patterns, soft/hard delete, and retroactive change processing - Experience with Synapse SQL Pool — stored procedures, control tables, and data quality validation patterns - Experience with audit, balance, and control frameworks — parameterized, modular pipeline governance at enterprise scale
- Experience with audit, balance, and control frameworks — parameterized, modular pipeline governance at enterprise scale - Familiarity with config-driven and automation-first pipeline patterns (YAML, PySpark, SQL-driven generation from mapping documents) Databricks & Lakehouse
- Hands-on experience with Azure Databricks (Delta Live Tables, Unity Catalog preferred) - Strong Apache Spark skills (PySpark / Spark SQL) - Experience migrating workloads from legacy data warehouse or Synapse environments to a Databricks Lakehouse
- Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models - Experience integrating complex data sources: Oracle DB, SQL Server, Azure SQL DB, file systems, Salesforce, APIs - Strong data modelling skills: relational, dimensional, and lakehouse-oriented
We are looking for an experienced Principal Data Engineer to work hands-on on the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires strong technical depth to audit, understand, and validate a complex end-to-end data architecture spanning source ingestion through to consumption — and to help deliver the migration of validated workloads to Databricks. This is hands on role and demands the ability to reverse-engineer existing implementations, assess their correctness, and build to an agreed migration strategy. Key Responsibilities
Core Technical Skills - Azure Synapse & Data Platform Mandatory hands-on expertise with: - Azure Synapse Analytics (Pipelines, Spark Pool, Dedicated SQL Pool)
- Azure Synapse Analytics (Pipelines, Spark Pool, Dedicated SQL Pool) - Azure Data Lake Storage Gen2 (ADLS Gen2) - Delta Lake on Azure (Synapse Lakehouse patterns)
- Azure Data Lake Storage Gen2 (ADLS Gen2) - Delta Lake on Azure (Synapse Lakehouse patterns) - Oracle Golden Gate Replication for real-time source integration
- Oracle Golden Gate Replication for real-time source integration - Azure Analysis Services and Power BI consumption layer patterns - Deep understanding of medallion architecture: Raw / Harmonized / Conformed / Consumption layers
Databricks & Lakehouse - Hands-on experience with Azure Databricks (Delta Live Tables, Unity Catalog preferred) - Strong Apache Spark skills (PySpark / Spark SQL)
DevOps & Automation - CI/CD pipelines for data engineering (Azure DevOps / GitHub Actions) - Infrastructure as Code (Terraform or ARM)
- Experience with Unity Catalog for data governance and lineage - Familiarity with Azure Purview for data cataloguing and governance - Exposure to real-time and streaming pipelines (Event Hub / Kafka / Kinesis)
- Familiarity with config-driven and automation-first pipeline patterns (YAML, PySpark, SQL-driven generation from mapping documents) Databricks & Lakehouse - Hands-on experience with Azure Databricks (Delta Live Tables, Unity Catalog preferred)
- Strong Apache Spark skills (PySpark / Spark SQL) - Experience migrating workloads from legacy data warehouse or Synapse environments to a Databricks Lakehouse - Ability to re-implement governance and control frameworks natively in Databricks (audit logging, reconciliation, DQ checks)
- Experience migrating workloads from legacy data warehouse or Synapse environments to a Databricks Lakehouse - Ability to re-implement governance and control frameworks natively in Databricks (audit logging, reconciliation, DQ checks) - Experience with Delta Lake features: MERGE, CDC, time travel, schema enforcement
- Ability to re-implement governance and control frameworks natively in Databricks (audit logging, reconciliation, DQ checks) - Experience with Delta Lake features: MERGE, CDC, time travel, schema enforcement Data Engineering & Development
- Infrastructure as Code (Terraform or ARM) - Containerization (Docker) - Experience with automated testing frameworks for data pipelines (unit testing, reconciliation-based validation)
- Familiarity with Azure Purview for data cataloguing and governance - Exposure to real-time and streaming pipelines (Event Hub / Kafka / Kinesis) - Experience with GenAI or ML platform integration (MLOps, feature engineering pipelines)
- Familiarity with monitoring and observability tools (e.g., Dynatrace) - Exposure to BI tools (Power BI, Tableau) Experience & Profile
- CI/CD pipelines for data engineering (Azure DevOps / GitHub Actions) - Infrastructure as Code (Terraform or ARM) - Containerization (Docker)

Your next step

Complete your application on career5.successfactors.eu. The employer’s form will show what is required.

Applying through Phenom

  • Phenom runs the employer’s careers site, but the application itself usually runs on another system, often Workday or Taleo. The advice for that system applies once you click Apply.

Already applied? Track this application

Job description

View original posting ↗

We are looking for an experienced Principal Data Engineer to work hands-on on the re-engineering of an existing enterprise data platform built on Azure Synapse Analytics. The role requires strong technical depth to audit, understand, and validate a complex end-to-end data architecture spanning source ingestion through to consumption — and to help deliver the migration of validated workloads to Databricks. This is hands on  role and demands the ability to reverse-engineer existing implementations, assess their correctness, and build to an agreed migration strategy.

Key Responsibilities

  • Contribute to the technical assessment and re-engineering of an existing enterprise data platform, spanning all layers from source ingestion through to data consumption
  • Reverse-engineer, document, and validate existing pipeline logic, data models, transformation frameworks, and data governance controls
  • Identify gaps, defects, and technical debt across the platform and remediate where implementations are incorrect or sub-optimal
  • Ensure correctness of data processing patterns including change data capture, slowly changing dimensions, deduplication, and business reconciliation
  • Implement target-state designs aligned to modern lakehouse principles, ensuring feature parity and business logic fidelity during transitions
  • Support platform evolution initiatives, including parallel-run phases where multiple implementations operate simultaneously, validating output consistency before cutover
  • Execute migration of existing workloads to modern data platforms, preserving existing governance and control framework semantics
  • Re-implement ingestion, transformation, and orchestration pipelines on target platforms, maintaining audit, quality, and reconciliation standards
  • Collaborate with business, data governance, and architecture stakeholders to validate embedded business rules and data quality requirements
  • Mentor less experienced engineers, review code and designs, and support decommission planning for legacy components

Core Technical Skills

  • Azure Synapse & Data Platform Mandatory hands-on expertise with:
  • Azure Synapse Analytics (Pipelines, Spark Pool, Dedicated SQL Pool)
  • Azure Data Lake Storage Gen2 (ADLS Gen2)
  • Delta Lake on Azure (Synapse Lakehouse patterns)
  • Oracle Golden Gate Replication for real-time source integration
  • Azure Analysis Services and Power BI consumption layer patterns
  • Deep understanding of medallion architecture: Raw / Harmonized / Conformed / Consumption layers
  • Strong knowledge of SCD Type 0/1/2, CDC patterns, soft/hard delete, and retroactive change processing
  • Experience with Synapse SQL Pool — stored procedures, control tables, and data quality validation patterns
  • Experience with audit, balance, and control frameworks — parameterized, modular pipeline governance at enterprise scale
  • Familiarity with config-driven and automation-first pipeline patterns (YAML, PySpark, SQL-driven generation from mapping documents)

 

Databricks & Lakehouse

  • Hands-on experience with Azure Databricks (Delta Live Tables, Unity Catalog preferred)
  • Strong Apache Spark skills (PySpark / Spark SQL)
  • Experience migrating workloads from legacy data warehouse or Synapse environments to a Databricks Lakehouse
  • Ability to re-implement governance and control frameworks natively in Databricks (audit logging, reconciliation, DQ checks)
  • Experience with Delta Lake features: MERGE, CDC, time travel, schema enforcement

 

Data Engineering & Development

  • Strong Python and SQL programming skills
  • Experience with ETL/ELT at scale: denormalization, surrogate keys, directory tables, curated data models
  • Experience integrating complex data sources: Oracle DB, SQL Server, Azure SQL DB, file systems, Salesforce, APIs
  • Strong data modelling skills: relational, dimensional, and lakehouse-oriented

 

DevOps & Automation

  • CI/CD pipelines for data engineering (Azure DevOps / GitHub Actions)
  • Infrastructure as Code (Terraform or ARM)
  • Containerization (Docker)
  • Experience with automated testing frameworks for data pipelines (unit testing, reconciliation-based validation)

 

Nice to Have

  • Experience with Unity Catalog for data governance and lineage
  • Familiarity with Azure Purview for data cataloguing and governance
  • Exposure to real-time and streaming pipelines (Event Hub / Kafka / Kinesis)
  • Experience with GenAI or ML platform integration (MLOps, feature engineering pipelines)
  • Familiarity with monitoring and observability tools (e.g., Dynatrace)
  • Exposure to BI tools (Power BI, Tableau)

Experience & Profile

  • 7+ years of hands-on experience in Data Engineering, including platform migration or re-engineering work
  • Proven track record working on existing, complex enterprise data platforms — not just building from scratch
  • Deep knowledge of enterprise data governance patterns: audit trails, reconciliation, data quality controls, SCD versioning
  • Strong analytical mindset: ability to read existing implementations, identify intent versus defect, and make sound re-engineering decisions
  • Primarily hands-on, while comfortable contributing to technical design discussions
  • Strong communication skills — able to engage business, governance, and engineering stakeholders with clarity
  • Experience working in regulated or enterprise-scale environments (financial services a plus)

 

What we offer

  • We offer a hybrid work model which recognizes the value of striking a balance between in-person collaboration and remote working
  • We believe in rewarding performance and our compensation and benefits package includes health insurance, company bonus scheme, 401(K) with company match, company paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, an employee shares program and employee discounts From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered.
  • The annualized base pay range for this role is $110,000 - 150,000. The annual base salary range represents a nationwide market range. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role, and the skills, education, training, credentials and experience of the candidate. The base pay is just one component of the ATA total compensation package. As part of our comprehensive compensation and highly rated benefits programs, ATA also offers eligibility for an incentive-based annual bonus.

 

 

About Allianz Technology

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges is what makes us a unique employer. 

 

We are united by a shared commitment: to put our customers first and at the centre of everything we do. Their needs inspire our thinking and guide our actions.

 

Together, we can build an environment where everyone feels empowered and confident to explore, grow and shape a better future – for our customers and for the world around us. At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating for equal opportunities for all. The foundation for this is our inclusive workplace, where people and performance both matter, and where integrity, fairness, inclusion and trust are at the heart of our culture. 

 

We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.

 

Join us. Let’s care for tomorrow.

You.IT

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 861, the most 1,353, and the latest week had 1,022.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
We believe in rewarding performance and our compensation and benefits package includes health insurance, company bonus scheme, 401(K) with company match, company paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, an employee shares program and employee discounts From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered. The annualized base pay range for this role is $110,000 - 150,000. The annual base salary range represents a nationwide market range. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role, and the skills, education, training, credentials and experience of the candidate. The base pay is just one component of the ATA total compensation package. As part of our comprehensive compensation and highly rated benefits programs, ATA also offers eligibility for an incentive-based annual bonus. About Allianz Technology
Location & working pattern

Minneapolis, Minnesota, United States

What we offer - We offer a hybrid work model which recognizes the value of striking a balance between in-person collaboration and remote working - We believe in rewarding performance and our compensation and benefits package includes health insurance, company bonus scheme, 401(K) with company match, company paid holidays, paid time off, paid volunteer days, tuition reimbursement, paid parental leave, an employee shares program and employee discounts From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.