Back to jobs

Senior Data Engineer

Pay
Pay not listed
Work setting
Remote — work setting source
Location: Remote – India Employment Type: Full-Time, Permanent Job Summary
Listed location: Remote
Read the full posting
Employment
Full-time · Permanent — employment source
Location: Remote – India Employment Type: Full-Time, Permanent Job Summary
Read the full posting

What you’ll work on

Full posting
  • Design and maintain scalable data platforms and pipelines on Microsoft Azure

  • Build batch and real-time data ingestion frameworks from many data sources

  • Design data lake, data warehouse, and lakehouse architectures

  • Develop and manage ETL/ELT processes and data quality frameworks

  • Optimize data storage, processing, and query performance

From the employer’s posting
Design, develop, and maintain scalable data platforms and data pipelines on Microsoft Azure.
Build and optimize batch and real-time data ingestion frameworks from multiple structured and unstructured data sources.
Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting workloads.
Develop and manage ETL/ELT processes using modern cloud-native data engineering practices.
Optimize data storage, processing, and query performance across enterprise data platforms.

What you’ll bring

All qualifications

Preferred experience

  • Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
  • Experience with Microsoft Fabric Data Engineering and Analytics solutions.
  • Experience with Databricks, Delta Lake, and lakehouse implementations.
  • Knowledge of containerization technologies such as Docker and Kubernetes.
Qualification wording
Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
Experience with Microsoft Fabric Data Engineering and Analytics solutions.
Experience with Databricks, Delta Lake, and lakehouse implementations.
Knowledge of containerization technologies such as Docker and Kubernetes.
Apply at NorthBay Solutions

Posting record

Report an error
Status in our records
Live
First seen by us
Aug 28, 202685 days ago
Recorded sightings
182
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 85

Up longer than most. Similar jobs usually come down between day 6 and day 56.

At NorthBay Solutions, jobs usually come down by about day 111.

From 14,770 similar postings that came down, and 11 of NorthBay Solutions’s. Coming down is not always a hire.

NorthBay Solutions is hiring

39 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring has slowed
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • Scala
  • SQL
  • Azure
  • BigQuery
  • Databricks
  • Delta Lake
  • Docker
  • Kafka
  • Kubernetes
  • Power BI
  • Snowflake
  • Spark
  • Terraform
  • PySpark
Where the posting names them
- Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks. - Strong programming skills in Python, Scala, or Java. - Experience with dimensional modeling, data warehousing concepts, and modern lakehouse architectures.
- Strong hands-on experience with Microsoft Azure Data Services. - Expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database. - Experience building and managing large-scale ETL/ELT pipelines and data integration solutions.
- Experience building and managing large-scale ETL/ELT pipelines and data integration solutions. - Strong proficiency in SQL, query optimization, and database performance tuning. - Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks.
Job Summary We are seeking an experienced Senior Data Engineer with 8–10+ years of experience in designing, developing, and managing modern data platforms, data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong expertise in Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures. The role requires hands-on experience in building scalable, secure, and high-performance data solutions that support enterprise analytics, reporting, AI, and business intelligence initiatives. Key Responsibilities
Key Responsibilities - Design, develop, and maintain scalable data platforms and data pipelines on Microsoft Azure. - Build and optimize batch and real-time data ingestion frameworks from multiple structured and unstructured data sources.
- Optimize data storage, processing, and query performance across enterprise data platforms. - Implement security, governance, monitoring, and compliance best practices across Azure environments. - Support integration of data platforms with AI/ML, business intelligence, and enterprise applications.
- 8–10+ years of experience in Data Engineering, Data Warehousing, and Enterprise Data Platform development. - Strong hands-on experience with Microsoft Azure Data Services. - Expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database.
- Experience with Databricks, Delta Lake, and lakehouse implementations. - Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics. - Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
- Experience with data governance tools such as Microsoft Purview. - Microsoft Azure Data Engineering certifications are highly preferred. - Experience working in Agile/Scrum environments.
- Experience with Infrastructure as Code (Terraform, ARM Templates, or Bicep). - Familiarity with Snowflake, BigQuery, or other cloud data warehouse platforms. - Experience with enterprise-scale data migration and modernization projects.
- Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads. - Experience with Databricks, Delta Lake, and lakehouse implementations. - Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
- Exposure to MLOps and DataOps practices. - Knowledge of containerization technologies such as Docker and Kubernetes. - Experience with Infrastructure as Code (Terraform, ARM Templates, or Bicep).
- Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms. - Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures. - Experience with data governance tools such as Microsoft Purview.
- Strong proficiency in SQL, query optimization, and database performance tuning. - Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks. - Strong programming skills in Python, Scala, or Java.
- Knowledge of containerization technologies such as Docker and Kubernetes. - Experience with Infrastructure as Code (Terraform, ARM Templates, or Bicep). - Familiarity with Snowflake, BigQuery, or other cloud data warehouse platforms.

Your next step

Complete your application on northbay.applytojob.com. The employer’s form will show what is required.

Applying through JazzHR

  • No account needed: one application form on the employer’s applytojob.com page.

Already applied? Track this application

Has NorthBay Solutions posted this job before?

Yes. We’ve followed 4 other Senior Data Engineer jobs there since June 2026. All 4 are still up.

  1. LahoreStill up after 147 days, first seen Jun 27
  2. IslamabadStill up after 147 days, first seen Jun 27
  3. KarachiStill up after 147 days, first seen Jun 27
  4. This jobUp 86 days so far, first seen Aug 28
  5. KarnatakaStill up after 34 days, first seen Oct 19

Large employers often post one title for several teams, so these can be separate openings.

Job description

View original posting ↗

Location: Remote – India
Employment Type: Full-Time, Permanent

Job Summary

We are seeking an experienced Senior Data Engineer with 8–10+ years of experience in designing, developing, and managing modern data platforms, data pipelines, and cloud-based analytics solutions. The ideal candidate will have strong expertise in Azure Data Services, large-scale data processing, data warehousing, ETL/ELT frameworks, and cloud-native data architectures. The role requires hands-on experience in building scalable, secure, and high-performance data solutions that support enterprise analytics, reporting, AI, and business intelligence initiatives.

Key Responsibilities

  • Design, develop, and maintain scalable data platforms and data pipelines on Microsoft Azure.
  • Build and optimize batch and real-time data ingestion frameworks from multiple structured and unstructured data sources.
  • Design and implement data lake, data warehouse, and lakehouse architectures to support analytics and reporting workloads.
  • Develop and manage ETL/ELT processes using modern cloud-native data engineering practices.
  • Implement data transformation, cleansing, validation, and quality frameworks to ensure data accuracy and reliability.
  • Collaborate with business stakeholders, data analysts, data scientists, and application teams to understand data requirements and deliver scalable solutions.
  • Optimize data storage, processing, and query performance across enterprise data platforms.
  • Implement security, governance, monitoring, and compliance best practices across Azure environments.
  • Support integration of data platforms with AI/ML, business intelligence, and enterprise applications.
  • Participate in architecture reviews, code reviews, troubleshooting, and technical mentoring activities.
  • Ensure high availability, scalability, and operational excellence of data platforms and pipelines.

Required Skills & Qualifications

  • 8–10+ years of experience in Data Engineering, Data Warehousing, and Enterprise Data Platform development.
  • Strong hands-on experience with Microsoft Azure Data Services.
  • Expertise in Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), and Azure SQL Database.
  • Experience building and managing large-scale ETL/ELT pipelines and data integration solutions.
  • Strong proficiency in SQL, query optimization, and database performance tuning.
  • Hands-on experience with PySpark, Apache Spark, and distributed data processing frameworks.
  • Strong programming skills in Python, Scala, or Java.
  • Experience with dimensional modeling, data warehousing concepts, and modern lakehouse architectures.
  • Experience working with structured, semi-structured, and unstructured data.
  • Strong understanding of data governance, data quality, metadata management, and security best practices.
  • Experience with REST APIs, data integration patterns, and enterprise system connectivity.
  • Hands-on experience with Git, CI/CD pipelines, and DevOps practices.
  • Strong analytical, problem-solving, and communication skills.

Preferred Qualifications

  • Experience with Microsoft Fabric, OneLake, Dataflows, and Fabric Data Engineering workloads.
  • Experience with Databricks, Delta Lake, and lakehouse implementations.
  • Knowledge of real-time streaming technologies such as Azure Event Hubs, Apache Kafka, or Azure Stream Analytics.
  • Experience supporting AI/ML and advanced analytics workloads through enterprise data platforms.
  • Familiarity with Power BI datasets, semantic models, and enterprise reporting architectures.
  • Experience with data governance tools such as Microsoft Purview.
  • Microsoft Azure Data Engineering certifications are highly preferred.
  • Experience working in Agile/Scrum environments.

Nice to Have

  • Experience with Microsoft Fabric Data Engineering and Analytics solutions.
  • Exposure to MLOps and DataOps practices.
  • Knowledge of containerization technologies such as Docker and Kubernetes.
  • Experience with Infrastructure as Code (Terraform, ARM Templates, or Bicep).
  • Familiarity with Snowflake, BigQuery, or other cloud data warehouse platforms.
  • Experience with enterprise-scale data migration and modernization projects.
  • Understanding of Generative AI, Vector Databases, and data platforms supporting AI workloads.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Remote

Location: Remote – India Employment Type: Full-Time, Permanent Job Summary
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.