These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
How this job compares
Time since we first saw it
Day 4
656
Early. Similar jobs usually come down between day 6 and day 56.
At Datamatics, jobs usually come down by about day 7.
From 14,771 similar postings that came down, and 167 of Datamatics’s. Coming down is not always a hire.
Datamatics is hiring
61 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
Azure
Databricks
Spark
PySpark
Where the posting names them
- 4+ years in data engineering, preferably within UAE government or regulated-sector environments.
- Advanced SQL, Python and PySpark/Spark skills.
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
- Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
- Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
- Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
Summary (Data Engineer)
Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.
Responsibilities
Responsibilities
- Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
- Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
- Advanced SQL, Python and PySpark/Spark skills.
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
- Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
- Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
- Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
- Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
Timely, reliable data pipelines are what turn a platform design into business value. The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed. The role works alongside the data architect, data quality engineer, business analysts and AI engineers, delivering production-grade pipelines on Azure / Microsoft Fabric, with metadata and lineage captured in Microsoft Purview.
Responsibilities
Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines.
Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic.
Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs.
Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer.
Ensure that pipelines publish metadata and lineage to Microsoft Purview.
Implement scheduling, dependency management, parameterization, error handling and alerting.
Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency.
Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR.
Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion.
Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover.
Must Have
4+ years in data engineering, preferably within UAE government or regulated-sector environments.
Advanced SQL, Python and PySpark/Spark skills.
Hands-on experience with Azure Data Factory, Microsoft Fabric, Databricks or Synapse.
Strong understanding of Lakehouse/Medallion architecture, Delta/Parquet formats and dimensional modelling, including SCDs and surrogate keys.
Experience with CI/CD (Azure DevOps or GitHub), source control and DataOps practices.
Familiarity with Microsoft Purview metadata and lineage, and with DQ tooling.
Awareness of UAE data regulation, including UAE PDPL, the Dubai Data Law and DESC ISR.
Excellent English communication and documentation skills.
Good to Have
Arabic proficiency is an advantage.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.