Back to jobs

Senior Data Engineer

Karnataka, Bengaluru, India

Live, first seen by us 33 days ago
Pay
Pay not listed
Work setting
Not stated
Employment
Full-time · Permanent — employment source
Location: Abu Dhabi, United Arab Emirates (UAE) Employment Type: Full-Time, Permanent Work Model: Onsite Required Experience: 6–10 Years Job Summary
Location: Abu Dhabi, United Arab Emirates (UAE) Employment Type: Full-Time, Permanent Work Model: Onsite
Read the full posting

What you’ll work on

Full posting
  • Design and maintain scalable data platforms and pipelines on Microsoft Azure

  • Build batch and real-time ingestion for structured, semi-structured and unstructured data

  • Design data lake, data warehouse and lakehouse architectures for analytics

  • Develop and optimize ETL/ELT pipelines and data quality frameworks

  • Integrate data platforms with AI/ML tools, BI tools and enterprise applications

From the employer’s posting
Design, develop, and maintain scalable data platforms and data pipelines using Microsoft Azure services.
Build and optimize batch and real-time data ingestion frameworks for structured, semi-structured, and unstructured data sources.
Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting requirements.
Develop, manage, and optimize ETL/ELT pipelines using modern cloud-native data engineering practices.
Integrate enterprise data platforms with AI/ML solutions, business intelligence tools, and enterprise applications.

What you’ll bring

All qualifications

Preferred experience

  • Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
  • Hands-on experience with Databricks, Delta Lake, and lakehouse implementations.
  • Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
  • Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
Qualification wording
Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
Hands-on experience with Databricks, Delta Lake, and lakehouse implementations.
Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
Apply at NorthBay Solutions

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 19, 202633 days ago
Recorded sightings
37
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 33

Similar jobs usually come down between day 6 and day 56.

At NorthBay Solutions, jobs usually come down by about day 111.

From 14,770 similar postings that came down, and 11 of NorthBay Solutions’s. Coming down is not always a hire.

NorthBay Solutions is hiring

39 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring has slowed
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • Scala
  • SQL
  • Azure
  • BigQuery
  • Databricks
  • Delta Lake
  • Docker
  • Kafka
  • Kubernetes
  • Power BI
  • Snowflake
  • Spark
  • Terraform
  • PySpark
Where the posting names them
- Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks. - Strong programming skills in Python, with exposure to Scala or Java being an advantage. - Solid understanding of dimensional modeling, data warehousing principles, and modern lakehouse architectures.
- Strong hands-on experience with Microsoft Azure Data Services and cloud-based data engineering solutions. - Practical expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure SQL Database. - Experience designing, developing, and maintaining large-scale ETL/ELT pipelines and data integration frameworks.
- Experience designing, developing, and maintaining large-scale ETL/ELT pipelines and data integration frameworks. - Strong proficiency in SQL, query optimization, and database performance tuning. - Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks.
Job Summary We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures. The role involves building secure, reliable, and high-performance data solutions that support enterprise analytics, business intelligence, reporting, and AI/ML initiatives. The successful candidate will collaborate with cross-functional teams to deliver robust data engineering solutions aligned with business and technical requirements.
Key Responsibilities - Design, develop, and maintain scalable data platforms and data pipelines using Microsoft Azure services. - Build and optimize batch and real-time data ingestion frameworks for structured, semi-structured, and unstructured data sources.
- Optimize data storage, processing, and query performance across enterprise data platforms. - Implement data security, governance, monitoring, metadata management, and compliance best practices across Azure environments. - Integrate enterprise data platforms with AI/ML solutions, business intelligence tools, and enterprise applications.
- 6–10 years of professional experience in Data Engineering, Data Warehousing, or Enterprise Data Platform development. - Strong hands-on experience with Microsoft Azure Data Services and cloud-based data engineering solutions. - Practical expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure SQL Database.
- Hands-on experience with Databricks, Delta Lake, and lakehouse implementations. - Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics. - Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
- Experience with data governance tools such as Microsoft Purview. - Microsoft Azure Data Engineering certifications are highly desirable. - Experience working in Agile/Scrum environments.
- Work on modern enterprise data platforms and cloud-based analytics solutions. - Gain exposure to advanced Azure data engineering and lakehouse technologies. - Contribute to data initiatives supporting business intelligence, analytics, and AI/ML applications.
- Experience with Infrastructure as Code tools, including Terraform, ARM templates, or Bicep. - Familiarity with Snowflake, Google BigQuery, or other cloud data warehouse platforms. - Experience with enterprise-scale data migration, modernization, and cloud transformation projects.
- Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads. - Hands-on experience with Databricks, Delta Lake, and lakehouse implementations. - Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
- Exposure to DataOps and MLOps practices. - Knowledge of containerization technologies such as Docker and Kubernetes. - Experience with Infrastructure as Code tools, including Terraform, ARM templates, or Bicep.
- Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms. - Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures. - Experience with data governance tools such as Microsoft Purview.
- Strong proficiency in SQL, query optimization, and database performance tuning. - Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks. - Strong programming skills in Python, with exposure to Scala or Java being an advantage.
- Knowledge of containerization technologies such as Docker and Kubernetes. - Experience with Infrastructure as Code tools, including Terraform, ARM templates, or Bicep. - Familiarity with Snowflake, Google BigQuery, or other cloud data warehouse platforms.

Your next step

Complete your application on northbay.applytojob.com. The employer’s form will show what is required.

Applying through JazzHR

  • No account needed: one application form on the employer’s applytojob.com page.

Already applied? Track this application

Has NorthBay Solutions posted this job before?

Yes. We’ve followed 4 other Senior Data Engineer jobs there since June 2026. All 4 are still up.

  1. LahoreStill up after 147 days, first seen Jun 27
  2. IslamabadStill up after 147 days, first seen Jun 27
  3. KarachiStill up after 147 days, first seen Jun 27
  4. Place not statedStill up after 86 days, first seen Aug 28
  5. This jobUp 34 days so far, first seen Oct 19

Large employers often post one title for several teams, so these can be separate openings.

Job description

View original posting ↗

Location: Abu Dhabi, United Arab Emirates (UAE)
Employment Type: Full-Time, Permanent
Work Model: Onsite
Required Experience: 6–10 Years

Job Summary

We are seeking an experienced Senior Data Engineer to design, develop, and manage modern data platforms, scalable data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong hands-on expertise in Microsoft Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures.

The role involves building secure, reliable, and high-performance data solutions that support enterprise analytics, business intelligence, reporting, and AI/ML initiatives. The successful candidate will collaborate with cross-functional teams to deliver robust data engineering solutions aligned with business and technical requirements.

Key Responsibilities

  • Design, develop, and maintain scalable data platforms and data pipelines using Microsoft Azure services.
  • Build and optimize batch and real-time data ingestion frameworks for structured, semi-structured, and unstructured data sources.
  • Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting requirements.
  • Develop, manage, and optimize ETL/ELT pipelines using modern cloud-native data engineering practices.
  • Implement data transformation, cleansing, validation, and data quality frameworks to ensure data accuracy and consistency.
  • Collaborate with business stakeholders, data analysts, data scientists, and application teams to translate requirements into scalable data solutions.
  • Optimize data storage, processing, and query performance across enterprise data platforms.
  • Implement data security, governance, monitoring, metadata management, and compliance best practices across Azure environments.
  • Integrate enterprise data platforms with AI/ML solutions, business intelligence tools, and enterprise applications.
  • Develop and maintain data models, reusable components, and efficient data processing workflows.
  • Participate in architecture reviews, code reviews, technical troubleshooting, and continuous improvement initiatives.
  • Support data platform reliability, scalability, high availability, and operational excellence.
  • Implement version control, CI/CD pipelines, and DevOps practices for data engineering workloads.
  • Contribute to technical documentation, knowledge sharing, and mentoring of team members where required.

Required Skills and Qualifications

  • Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or a related field.
  • 6–10 years of professional experience in Data Engineering, Data Warehousing, or Enterprise Data Platform development.
  • Strong hands-on experience with Microsoft Azure Data Services and cloud-based data engineering solutions.
  • Practical expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage Gen2 (ADLS Gen2), and Azure SQL Database.
  • Experience designing, developing, and maintaining large-scale ETL/ELT pipelines and data integration frameworks.
  • Strong proficiency in SQL, query optimization, and database performance tuning.
  • Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks.
  • Strong programming skills in Python, with exposure to Scala or Java being an advantage.
  • Solid understanding of dimensional modeling, data warehousing principles, and modern lakehouse architectures.
  • Experience processing structured, semi-structured, and unstructured data.
  • Knowledge of data governance, data quality, metadata management, and data security best practices.
  • Experience with REST APIs, enterprise data integration patterns, and connectivity with business applications.
  • Familiarity with Git, CI/CD pipelines, and DevOps practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Effective communication and collaboration skills, with the ability to work across technical and business teams.

Preferred Qualifications

  • Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
  • Hands-on experience with Databricks, Delta Lake, and lakehouse implementations.
  • Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
  • Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
  • Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures.
  • Experience with data governance tools such as Microsoft Purview.
  • Microsoft Azure Data Engineering certifications are highly desirable.
  • Experience working in Agile/Scrum environments.

Additional Skills: Nice to Have

  • Experience with Microsoft Fabric Data Engineering and analytics solutions.
  • Exposure to DataOps and MLOps practices.
  • Knowledge of containerization technologies such as Docker and Kubernetes.
  • Experience with Infrastructure as Code tools, including Terraform, ARM templates, or Bicep.
  • Familiarity with Snowflake, Google BigQuery, or other cloud data warehouse platforms.
  • Experience with enterprise-scale data migration, modernization, and cloud transformation projects.
  • Understanding of Generative AI, vector databases, and data platforms supporting AI workloads.

Work Location and Employment Details

  • Location: Abu Dhabi, United Arab Emirates (UAE)
  • Employment Type: Full-Time, Permanent
  • Work Model: Onsite
  • Required Experience: 6–10 Years

Why Join Us?

  • Work on modern enterprise data platforms and cloud-based analytics solutions.
  • Gain exposure to advanced Azure data engineering and lakehouse technologies.
  • Contribute to data initiatives supporting business intelligence, analytics, and AI/ML applications.
  • Collaborate with multidisciplinary teams in a technology-driven environment.
  • Participate in enterprise data modernization and continuous improvement initiatives.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Karnataka, Bengaluru, India

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.