Back to jobs

Senior Data Platform Engineer CR 12/11/26

Pay
Pay not listed
Work setting
Remote — work setting source
Work setup in the employer’s posting: remote
From the employer’s posting
Employment
Employment terms need review — employment source
Employment type Permanent contract & B2B
Read the full posting

What you’ll work on

Full posting
  • Own the Apache Airflow platform, including deployments, upgrades, and DAG standards

  • Lead the migration from Azure Data Factory to Airflow

  • Manage Azure resources with Terraform infrastructure as code

From the employer’s posting
Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards
Work on the migration from Azure Data Factory to Airflow
Manage Azure resources with Infrastructure as Code (Terraform)

What you’ll bring

All qualifications

Core experience

  • 6+ years of experience in data engineering, with significant time on platform or infrastructure topics
  • Ability to work in cross-functional teams and to influence without authority
  • Hands-on experience with Azure resource management:
  • Ownership mindset and attention to detail
  • Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance)
  • Good communication skills with both technical and business stakeholders: leads with the recommendation, quantifies, and is transparent about uncertainty
Qualification wording
6+ years of experience in data engineering, with significant time on platform or infrastructure topics
Ability to work in cross-functional teams and to influence without authority
Hands-on experience with Azure resource management:
Ownership mindset and attention to detail
Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance)
Good communication skills with both technical and business stakeholders: leads with the recommendation, quantifies, and is transparent about uncertainty
Apply at Margo-Group

Posting record

Report an error

Actively hiringFirst seen by us 10 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 11, 202610 days ago
Recorded sightings
11
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 10

Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Margo-Group is hiring

4 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Terraform
  • Airflow
  • PySpark
Where the posting names them
- 6+ years of experience in data engineering, with significant time on platform or infrastructure topics - Strong technical expertise with Python and SQL (advanced), including PySpark and Delta Lake semantics - Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations, upgrades, and orchestration of Databricks and ADF workloads
We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture. This role is focused on the platform itself. The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF), Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code, Databricks and Unity Catalog governance, observability and cost efficiency, while remaining hands-on and close to the teams that use the platform.
We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture. This role is focused on the platform itself. The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF), Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code, Databricks and Unity Catalog governance, observability and cost efficiency, while remaining hands-on and close to the teams that use the platform. Key Responsibilities
- Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards. - Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns). - Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring and clear failure ownership.
- Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring and clear failure ownership. Azure Resource Management - Manage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking and supporting services.
Azure Resource Management - Manage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking and supporting services. - Own secrets and identity management: Key Vault, service principals and managed identities, secret scopes and rotation.
- Own secrets and identity management: Key Vault, service principals and managed identities, secret scopes and rotation. - Own access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege, plus access requests and periodic reviews. - Own Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state.
- Own access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege, plus access requests and periodic reviews. - Own Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state. - Track cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging).
- Own Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state. - Track cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging). Hands-on Data Platform evolution
- Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations, upgrades, and orchestration of Databricks and ADF workloads - Hands-on experience with Azure resource management: - Key Vault, managed identities and service principals, secret management
- Key Vault, managed identities and service principals, secret management - Access management: Azure RBAC, Entra ID, Unity Catalog permissions - Azure DevOps (repos, pipelines, service connections, environments) and CI/CD for data platforms
- Access management: Azure RBAC, Entra ID, Unity Catalog permissions - Azure DevOps (repos, pipelines, service connections, environments) and CI/CD for data platforms - ADLS, networking and security basics, Azure Data Factory
- Azure DevOps (repos, pipelines, service connections, environments) and CI/CD for data platforms - ADLS, networking and security basics, Azure Data Factory - Infrastructure as Code (Terraform) and multi-environment promotion
- Drive observability: pipelines that are observable, debuggable and alert-driven, with clear ownership of failures. - Operate the Databricks platform: Unity Catalog structure, cluster and job policies, Auto Loader ingestion patterns, and performance and cost optimization of workloads. Technical Leadership
- Strong technical expertise with Python and SQL (advanced), including PySpark and Delta Lake semantics - Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations, upgrades, and orchestration of Databricks and ADF workloads - Hands-on experience with Azure resource management:
- Infrastructure as Code (Terraform) and multi-environment promotion - Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance) - Observability and monitoring, alerting and incident management
- ADLS, networking and security basics, Azure Data Factory - Infrastructure as Code (Terraform) and multi-environment promotion - Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance)
Key Responsibilities Orchestration Platform (Apache Airflow & ADF) - Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards.
Orchestration Platform (Apache Airflow & ADF) - Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards. - Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns).

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

We are looking for a Senior Data Platform Engineer to help drive the evolution of our Azure-based Data Platform and Lakehouse architecture.

This role is focused on the platform itself. The professional will own and evolve the foundations that data product teams build on: Apache Airflow orchestration (migrating from ADF), Azure resource management (Key Vault, identity and access, networking, storage), Azure DevOps CI/CD and Infrastructure as Code, Databricks and Unity Catalog governance, observability and cost efficiency, while remaining hands-on and close to the teams that use the platform.

Key Responsibilities

    Orchestration Platform (Apache Airflow & ADF)

  • Own the Apache Airflow platform: environments, deployment, upgrades, configuration, connections, variables, pools and DAG standards.

  • Work on the migration from Azure Data Factory to Airflow and the evolution of the Metadata-Driven Orchestration Framework (DAG generation, reusable operators, dependency and scheduling patterns).

  • Ensure Airflow is reliable and observable: SLAs, alerting, retries, backfills, health monitoring and clear failure ownership.

  • Azure Resource Management

  • Manage Azure resources with Infrastructure as Code (Terraform): Databricks workspaces, Data Lake Storage, Data Factory, Key Vault, networking and supporting services.

  • Own secrets and identity management: Key Vault, service principals and managed identities, secret scopes and rotation.

  • Own access management: Azure RBAC, Entra ID groups, Unity Catalog grants and ownership, following least privilege, plus access requests and periodic reviews.

  • Own Azure DevOps: repositories, CI/CD pipelines, branch policies and multi-environment promotion, including deployment validation and Terraform state.

  • Track cost and governance of Azure resources: tagging, budgets, right-sizing and cost attribution (e.g. query tagging).

  • Hands-on Data Platform evolution

  • Contribute to the implementation of the Data Catalog and Data Quality Framework and it’s lineage across the platform.

  • Drive observability: pipelines that are observable, debuggable and alert-driven, with clear ownership of failures.

  • Operate the Databricks platform: Unity Catalog structure, cluster and job policies, Auto Loader ingestion patterns, and performance and cost optimization of workloads.

  • Technical Leadership

  • Participate in architecture reviews and technical decision-making, stating trade-offs (performance, cost, reliability, complexity) with data.

  • Define and promote engineering standards: naming conventions, patterns and guidelines, through code reviews and design reviews.

  • Collaborate with Architects, Product Owners and data engineers in technical maturation of data products.

  • Build and maintain developer tooling and automation, including AI-assisted engineering workflows (shared agent instructions, skills, automated PR review).

  • Support & Operations (Run Team Collaboration)

  • Provide second-line support to the Run/Operations team for complex production topics.

  • Troubleshoot and resolve platform incidents, failures and performance issues; lead root cause analysis and post-mortems.

  • Ensure proper handover, documentation and operational readiness of platform changes.

  • Continuously improve runbooks, monitoring and operational processes.

Technical Skills

  • 6+ years of experience in data engineering, with significant time on platform or infrastructure topics

  • Strong technical expertise with Python and SQL (advanced), including PySpark and Delta Lake semantics

  • Deep hands-on experience with Apache Airflow in production: DAG design, deployment, operations, upgrades, and orchestration of Databricks and ADF workloads

  • Hands-on experience with Azure resource management:

    • Key Vault, managed identities and service principals, secret management

    • Access management: Azure RBAC, Entra ID, Unity Catalog permissions

    • Azure DevOps (repos, pipelines, service connections, environments) and CI/CD for data platforms

    • ADLS, networking and security basics, Azure Data Factory

  • Infrastructure as Code (Terraform) and multi-environment promotion

  • Hands-on experience with Databricks and Unity Catalog (compute, jobs, governance)

  • Observability and monitoring, alerting and incident management

  • Solid understanding of Data Lakehouse architecture, Medallion architecture and metadata-driven architecture; awareness of cost management and performance

Soft Skills

  • Strong problem-solving and analytical thinking

  • Ability to work in cross-functional teams and to influence without authority

  • Ownership mindset and attention to detail

  • Good communication skills with both technical and business stakeholders: leads with the recommendation, quantifies, and is transparent about uncertainty

Employment type

Permanent contract & B2B

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Warsaw

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.