Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
Dubai, United Arab Emirates
Actively hiring, first seen by us 3 days agoWork setup in the employer’s posting: On-siteFrom the employer’s posting
Employment type in the employer’s posting: ContractFrom the employer’s posting
Build and maintain Azure Data Factory pipelines ingesting data from vendor APIs, webhooks and SFTP
Clean, deduplicate and standardize data in the Silver layer using PySpark and SQL
Run identity resolution to build golden records of visitor and exhibitor profiles
Optimize SQL queries and Spark jobs to cut Azure compute costs and latency
Implement data masking and security protocols for GDPR compliance
Build and manage robust ETL/ELT pipelines using Azure Data Factory to ingest data from 3rd-party vendors (REST APIs, Webhooks, SFTP).
Utilize PySpark (Azure Databricks/Synapse) and SQL to clean, deduplicate, and standardize data in the Silver Layer.
Execute Identity Resolution logic to stitch together visitor and exhibitor profiles from multiple touchpoints into a "Golden Record."
Optimize SQL queries and Spark jobs to reduce Azure compute costs and minimize data latency.
Implement data masking and security protocols to ensure GDPR and internal compliance.
Experience: 3–5 years in Data Engineering with a focus on Cloud environments.
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Core Azure Stack: Proven expertise in Azure Data Factory, Azure Synapse Analytics, and Data Lake Gen2. - Coding: High proficiency in SQL (complex joins/optimizations) and Python/PySpark. - Architectural Knowledge: Practical experience with the Medallion Architecture (Bronze/Silver/Gold).
2. Transformation & Modeling (Silver & Gold Layers) - Utilize PySpark (Azure Databricks/Synapse) and SQL to clean, deduplicate, and standardize data in the Silver Layer. - Execute Identity Resolution logic to stitch together visitor and exhibitor profiles from multiple touchpoints into a "Golden Record."
3. Infrastructure & Performance Optimization - Optimize SQL queries and Spark jobs to reduce Azure compute costs and minimize data latency. - Maintain the Data Dictionary and technical documentation to ensure the "Engine Room" logic is transparent and scalable.
As a Data Engineer, your main goal is to build and maintain the systems that process and store data for the Events & Exhibitions ecosystem. You will take scattered, vendor-specific data (from registration systems, apps, marketing tools) and transform it into a unified, AI-ready dataset using a Medallion Architecture on Azure. Think of it as organizing raw data into a structured pipeline that’s ready for analysis and machine learning.
1. Data Ingestion & API Integration (Bronze Layer) - Build and manage robust ETL/ELT pipelines using Azure Data Factory to ingest data from 3rd-party vendors (REST APIs, Webhooks, SFTP). - Ensure raw data is landed securely in Azure Data Lake Gen2 (Bronze Layer) without data loss.
- Build and manage robust ETL/ELT pipelines using Azure Data Factory to ingest data from 3rd-party vendors (REST APIs, Webhooks, SFTP). - Ensure raw data is landed securely in Azure Data Lake Gen2 (Bronze Layer) without data loss. - Implement error-handling and logging to monitor the health of real-time and batch ingestion jobs.
- Experience: 3–5 years in Data Engineering with a focus on Cloud environments. - Core Azure Stack: Proven expertise in Azure Data Factory, Azure Synapse Analytics, and Data Lake Gen2. - Coding: High proficiency in SQL (complex joins/optimizations) and Python/PySpark.
4. Business Enablement - Support the Senior Data Manager in building the Semantic Layer that feeds our Power BI "Data Window." - Collaborate with the Events Tech team to troubleshoot data discrepancies between front-end apps and back-end tables.
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
As a Data Engineer, your main goal is to build and maintain the systems that process and store data for the Events & Exhibitions ecosystem. You will take scattered, vendor-specific data (from registration systems, apps, marketing tools) and transform it into a unified, AI-ready dataset using a Medallion Architecture on Azure.
Think of it as organizing raw data into a structured pipeline that’s ready for analysis and machine learning.
Requirements
1. Data Ingestion & API Integration (Bronze Layer)
2. Transformation & Modeling (Silver & Gold Layers)
3. Infrastructure & Performance Optimization
4. Business Enablement
Technical Requirements
Benefits
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Dubai, United Arab Emirates
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.