Pay
$127K–$190K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,239 postings in the last year. Stated ranges, not salaries paid.
Azure Senior Data Lead (US)
United States
Actively hiring, first seen by us 22 hours ago- Pay
- Pay not listedSimilar roles state $127K–$190K
- Work setting
- Not stated
- Employment
- Not stated
Before you apply
- Employer’s visa record
- 5,157 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
What you’ll work on
Full postingDesign and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python.
Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
Develop data ingestion and transformation workflows using Azure Data Factory (ADF).
From the employer’s posting
Key Responsibilities Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python. Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python. Build and maintain ETL/ELT pipelines for batch and large-scale data processing. Develop data ingestion and transformation workflows using Azure Data Factory (ADF).
Build and maintain ETL/ELT pipelines for batch and large-scale data processing. Develop data ingestion and transformation workflows using Azure Data Factory (ADF). Design and implement Delta Lake / Lakehouse solutions.
What you’ll bring
All qualificationsCore experience
- 9+ years of overall data engineering experience
- Hands-on Azure Databricks, Apache Spark, and PySpark experience
- 4+ years of hands-on Databricks/Spark experience preferred
Preferred experience
- 4+years of hands-on Databricks/Spark experience preferred.
Qualification wording
9+ years of overall Data Engineering experience.
strong hands-on experience with Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory (ADF)
4+years of hands-on Databricks/Spark experience preferred.
Posting record
Report an errorActively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
- Status in our records
- Live
- First seen by us
- Nov 14, 2026today
- Recorded sightings
- 2
- Last seen by us
- Nov 15, 2026
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Time since we first saw it
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 13,754 similar postings that came down. Coming down is not always a hire.
HCL Technologies is hiring
370 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordSee how this role fits your experience
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Python
- SQL
- Azure
- Databricks
- Delta Lake
- Kafka
- Power BI
- Spark
- Terraform
- PySpark
Where the posting names them
Key Responsibilities - Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python. - Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
Primary Skill: Azure Databricks / Data Engineering Secondary Skills: PySpark, SQL, Python, Azure Data Factory, Delta Lake, ADLS Gen2
Job Description We are looking for an experienced Databricks Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The candidate should have strong hands-on experience with Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory (ADF), with a solid understanding of modern data lakehouse architectures. Key Responsibilities
- Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing. - Develop optimized PySpark and SQL transformations for large datasets. - Implement Delta tables, schema management, data quality checks, and performance optimization.
Good to Have - Databricks SQL - Structured Streaming
- Build and maintain ETL/ELT pipelines for batch and large-scale data processing. - Develop data ingestion and transformation workflows using Azure Data Factory (ADF). - Design and implement Delta Lake / Lakehouse solutions.
- Design and implement Delta Lake / Lakehouse solutions. - Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing. - Develop optimized PySpark and SQL transformations for large datasets.
- Monitor pipelines, troubleshoot failures, and optimize Spark workloads. - Implement CI/CD processes using Azure DevOps and Git. - Collaborate with Data Architects, Data Analysts, BI teams, and business stakeholders.
- 4+years of hands-on Databricks/Spark experience preferred. - Experience delivering cloud-based data platforms on Microsoft Azure. Other Requirements
Other Requirements Primary Skill: Azure Databricks / Data Engineering Secondary Skills: PySpark, SQL, Python, Azure Data Factory, Delta Lake, ADLS Gen2
- Implement Delta tables, schema management, data quality checks, and performance optimization. - Work with Databricks Workflows/Jobs for pipeline orchestration and scheduling. - Implement data governance and access controls using Unity Catalog.
- 9+ years of overall Data Engineering experience. - 4+years of hands-on Databricks/Spark experience preferred. - Experience delivering cloud-based data platforms on Microsoft Azure.
- Develop data ingestion and transformation workflows using Azure Data Factory (ADF). - Design and implement Delta Lake / Lakehouse solutions. - Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing.
- Develop optimized PySpark and SQL transformations for large datasets. - Implement Delta tables, schema management, data quality checks, and performance optimization. - Work with Databricks Workflows/Jobs for pipeline orchestration and scheduling.
- Structured Streaming - Kafka or Event Hubs - Power BI
- Collaborate with Data Architects, Data Analysts, BI teams, and business stakeholders. - Support downstream reporting and analytics solutions such as Power BI. Key Responsibilities
- Kafka or Event Hubs - Power BI - Terraform
- Power BI - Terraform - CI/CD automation
Your next step
Complete your application on careers.hcltech.com. The employer’s form will show what is required.
Applying through SAP SuccessFactors
- Images (.jpg) aren’t accepted as a resume.
Already applied? Track this application
About HCL Technologies
- People
- About 20,206 in 2024.Benefit plan filings (Form 5500)
- Company
- Listed as HCLTECH.NS.
- H-1B visas
- 754 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
- Layoff notices
- Notices this year and last cover 120 people. The latest was filed March 27, 2026.State WARN notices
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
- Median yearly pay, May 2025
- $139,500
- Expected change, 2025 to 2035
- 9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Job description
Job Summary
Job Description
We are looking for an experienced Databricks Data Engineer to design, develop, and maintain scalable data engineering solutions on the Azure cloud platform. The candidate should have strong hands-on experience with Azure Databricks, Apache Spark, PySpark, SQL, Delta Lake, and Azure Data Factory (ADF), with a solid understanding of modern data lakehouse architectures.
Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Python.
- Build and maintain ETL/ELT pipelines for batch and large-scale data processing.
- Develop data ingestion and transformation workflows using Azure Data Factory (ADF).
- Design and implement Delta Lake / Lakehouse solutions.
- Work with Azure Data Lake Storage Gen2 (ADLS Gen2) for data ingestion, storage, and processing.
- Develop optimized PySpark and SQL transformations for large datasets.
- Implement Delta tables, schema management, data quality checks, and performance optimization.
- Work with Databricks Workflows/Jobs for pipeline orchestration and scheduling.
- Implement data governance and access controls using Unity Catalog.
- Monitor pipelines, troubleshoot failures, and optimize Spark workloads.
- Implement CI/CD processes using Azure DevOps and Git.
- Collaborate with Data Architects, Data Analysts, BI teams, and business stakeholders.
- Support downstream reporting and analytics solutions such as Power BI.
Key Responsibilities
Good to Have
- Databricks SQL
- Structured Streaming
- Kafka or Event Hubs
- Power BI
- Terraform
- CI/CD automation
- Data modeling
- Data quality frameworks
- Microsoft Fabric exposure
Skill Requirements
Experience
- 9+ years of overall Data Engineering experience.
- 4+years of hands-on Databricks/Spark experience preferred.
- Experience delivering cloud-based data platforms on Microsoft Azure.
Other Requirements
Primary Skill: Azure Databricks / Data Engineering
Secondary Skills: PySpark, SQL, Python, Azure Data Factory, Delta Lake, ADLS Gen2
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
United States
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.