Design and develop lakehouse solutions using Fabric, OneLake, and Delta tables
Build ingestion and transformation pipelines with Data Factory, Dataflows Gen2, and notebooks
Implement Bronze, Silver, and Gold data layers using a medallion architecture
Implement incremental loading, change data capture, and data validation
Monitor pipelines, troubleshoot failures, and optimize performance
From the employer’s posting
Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables.
Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks.
Implement Bronze, Silver, and Gold data layers using a medallion architecture.
Implement incremental loading, change data capture, and data validation processes.
Monitor pipelines, troubleshoot failures, and optimize performance and resource usage.
About ABeam Consulting
ABeam Consulting is a global professional services company that specializes in delivering business transformation and technology solutions to clients across a wide range of industries.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
Azure
Databricks
Delta Lake
Power BI
SAP
Spark
PySpark
Where the posting names them
- Implement Bronze, Silver, and Gold data layers using a medallion architecture.
- Develop transformations using SQL, Python, PySpark, and Spark SQL.
- Implement incremental loading, change data capture, and data validation processes.
Required Skills and Experience- Hands-on experience with Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, and notebooks.
- Strong SQL skills and practical experience with Python or PySpark.
- Experience developing ETL/ELT pipelines and working with structured and semi-structured data.
- Strong analytical, troubleshooting, and communication skills.
Preferred Qualifications- Experience with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, or Azure Synapse Analytics.
- Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
Role Overview We are seeking a Microsoft Fabric Data Lake Developer to design, develop, and maintain scalable data solutions using Microsoft Fabric and OneLake. The role involves building data pipelines, implementing lakehouse architectures, and preparing reliable datasets for analytics and reporting.
Key Responsibilities- Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables.
- Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks.
- Experience developing ETL/ELT pipelines and working with structured and semi-structured data.
- Understanding of Delta Lake, Parquet, dimensional modelling, and medallion architecture.
- Experience implementing data quality checks, error handling, logging, and monitoring.
- Apply data security, access controls, governance, and data quality standards.
- Prepare curated datasets for Power BI reporting and downstream analytics.
- Collaborate with architects, business analysts, and reporting teams to translate requirements into technical solutions.
- Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
- Familiarity with Power BI semantic models and Direct Lake.
- Knowledge of Microsoft Purview and data governance practices.
Preferred Qualifications- Experience with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, or Azure Synapse Analytics.
- Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
- Familiarity with Power BI semantic models and Direct Lake.
ABeam Consulting is a global professional services company that specializes in delivering business transformation and technology solutions to clients across a wide range of industries. With a global presence and over 9000 employees worldwide we aim to be the transformation partner of choice for all of our clients.
Role Overview We are seeking a Microsoft Fabric Data Lake Developer to design, develop, and maintain scalable data solutions using Microsoft Fabric and OneLake. The role involves building data pipelines, implementing lakehouse architectures, and preparing reliable datasets for analytics and reporting.
Key Responsibilities
Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables.
Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks.
Integrate data from databases, APIs, enterprise applications, and file-based sources.
Implement Bronze, Silver, and Gold data layers using a medallion architecture.
Develop transformations using SQL, Python, PySpark, and Spark SQL.
Implement incremental loading, change data capture, and data validation processes.
Monitor pipelines, troubleshoot failures, and optimize performance and resource usage.
Apply data security, access controls, governance, and data quality standards.
Prepare curated datasets for Power BI reporting and downstream analytics.
Collaborate with architects, business analysts, and reporting teams to translate requirements into technical solutions.
Maintain technical documentation, source-to-target mappings, and operational support procedures.
Support version control, testing, and deployment across development, test, and production environments.
Required Skills and Experience
Hands-on experience with Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, and notebooks.
Strong SQL skills and practical experience with Python or PySpark.
Experience developing ETL/ELT pipelines and working with structured and semi-structured data.
Understanding of Delta Lake, Parquet, dimensional modelling, and medallion architecture.
Experience implementing data quality checks, error handling, logging, and monitoring.
Knowledge of data security, workspace permissions, and access management.
Familiarity with Git and CI/CD practices for data solutions.
Strong analytical, troubleshooting, and communication skills.
Preferred Qualifications
Experience with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, or Azure Synapse Analytics.
Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
Familiarity with Power BI semantic models and Direct Lake.
Knowledge of Microsoft Purview and data governance practices.
Why Join Us
At ABeam Consulting, we place a strong emphasis on collaboration, and helping our employees grow and develop their skills, offering a supportive and empowering work environment. With a presence in multiple countries and a diverse range of clients, ABeam Consulting offers an exciting and dynamic workplace for individuals looking to build a career in consulting. ABeam Consulting has also recently joined SAP’s regional strategic partner initiative as their first regional partner in the region and has also been recognized by UiPath as a Diamond Partner in providing RPA solutions. With such accolades, we aim to continue driving enterprise and digital transformation initiatives in order to transform the way people work and communicate in the digital age. In addition, our industry team is working tirelessly in order to bring more solutions to the banking and finance sector.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.