Lead Data Engineer
Bangalore
- Pay
- Salary not listed in the saved posting
- Work setup
- Unconfirmed
- Employment
- Unconfirmed
What you’ll work on
Full postingWe are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks.
The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations.
You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations.
Design and develop scalable data pipelines and Lakehouse solutions on Databricks.
Design and operationalize Unity Catalog for data governance — access control, lineage, and security.
From the employer’s posting
We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing modern data and AI capabilities on Lakehouse.
The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations.
We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing modern data and AI capabilities on Lakehouse. The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations. Key Responsibilities:
Key Responsibilities: Design and develop scalable data pipelines and Lakehouse solutions on Databricks. Tune Databricks workloads for performance and cost, including cluster sizing, query optimization, and Delta Lake table design.
Track performance trends, identify high-cost queries, and partner with source teams and end users to resolve long-running loads. Design and operationalize Unity Catalog for data governance — access control, lineage, and security. Build monitoring and self-healing automation using Databricks-native AI and agentic capabilities.
What you’ll bring
All qualificationsCore experience
- Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent relevant experience.
- 6+ years of data engineering experience with 2+ years hands-on Databricks in enterprise settings.
- Deep understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Workflow orchestration.
- Proven ability to tune Spark workloads for cost and performance at production scale.
- Experience with observability tooling for Databricks.
Preferred experience
- Experience with Databricks-native AI capabilities and agentic frameworks.
- Familiarity with Databricks Serverless Compute and DBSQL performance tuning.
Qualification wording
Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent relevant experience.
6+ years of data engineering experience with 2+ years hands-on Databricks in enterprise settings.
Deep understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Workflow orchestration.
Proven ability to tune Spark workloads for cost and performance at production scale.
Experience with observability tooling for Databricks.
Experience with Databricks-native AI capabilities and agentic frameworks.
Familiarity with Databricks Serverless Compute and DBSQL performance tuning.
Tools in this posting
- Python
- SQL
- Databricks
- Delta
- PySpark
Source — Tool mentions in context
- Proven ability to tune Spark workloads for cost and performance at production scale. - Advanced Python (PySpark) and SQL skills. - Working knowledge of CI/CD practices and DevOps principles applied to data workloads.
Position Summary: We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing modern data and AI capabilities on Lakehouse. The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations.
We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing modern data and AI capabilities on Lakehouse. The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations. Key Responsibilities:
Key Responsibilities: - Design and develop scalable data pipelines and Lakehouse solutions on Databricks. - Tune Databricks workloads for performance and cost, including cluster sizing, query optimization, and Delta Lake table design.
- Design and develop scalable data pipelines and Lakehouse solutions on Databricks. - Tune Databricks workloads for performance and cost, including cluster sizing, query optimization, and Delta Lake table design. - Establish and enforce best practices for partitioning, clustering, and workload isolation.
- Design and operationalize Unity Catalog for data governance — access control, lineage, and security. - Build monitoring and self-healing automation using Databricks-native AI and agentic capabilities. - Drive CI/CD workflows for Databricks assets, setting DevOps best practices for deployment and release management.
- Build monitoring and self-healing automation using Databricks-native AI and agentic capabilities. - Drive CI/CD workflows for Databricks assets, setting DevOps best practices for deployment and release management. - Lead design reviews and mentor Data Engineers on Databricks best practices and AI-native features.
- Drive CI/CD workflows for Databricks assets, setting DevOps best practices for deployment and release management. - Lead design reviews and mentor Data Engineers on Databricks best practices and AI-native features. - Own Databricks vendor coordination — case management, escalations, and release adoption strategy.
- Lead design reviews and mentor Data Engineers on Databricks best practices and AI-native features. - Own Databricks vendor coordination — case management, escalations, and release adoption strategy. What Success Looks Like (First 6–12 Months)
- Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent relevant experience. - 6+ years of data engineering experience with 2+ years hands-on Databricks in enterprise settings. - Deep understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Workflow orchestration.
- 6+ years of data engineering experience with 2+ years hands-on Databricks in enterprise settings. - Deep understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Workflow orchestration. - Proven ability to tune Spark workloads for cost and performance at production scale.
- Working knowledge of CI/CD practices and DevOps principles applied to data workloads. - Experience with observability tooling for Databricks. Preferred Qualifications:
Preferred Qualifications: - Experience with Databricks-native AI capabilities and agentic frameworks. - Familiarity with Databricks Serverless Compute and DBSQL performance tuning.
- Experience with Databricks-native AI capabilities and agentic frameworks. - Familiarity with Databricks Serverless Compute and DBSQL performance tuning. - A Databricks Certified Professional.
- Familiarity with Databricks Serverless Compute and DBSQL performance tuning. - A Databricks Certified Professional. - Exposure to Infrastructure-as-Code is a plus.
Job description
Position Summary:
We are seeking an experienced Senior Data Engineer to drive the performance, governance, and AI-native maturity of our enterprise Data Platform in Databricks. This is a Databricks-focused Data Engineering role with a working understanding of DevOps practices — designing scalable pipelines, tuning workloads for performance and cost, and operationalizing modern data and AI capabilities on Lakehouse.
The ideal candidate has deep, hands-on Databricks expertise, a strong performance-engineering instinct, and a builder's mindset for AI-assisted operations. You'll own the Databricks performance and governance standards for the platform, mentor engineers, and shape the direction for AI-native operations.
Key Responsibilities:
- Design and develop scalable data pipelines and Lakehouse solutions on Databricks.
- Tune Databricks workloads for performance and cost, including cluster sizing, query optimization, and Delta Lake table design.
- Establish and enforce best practices for partitioning, clustering, and workload isolation.
- Track performance trends, identify high-cost queries, and partner with source teams and end users to resolve long-running loads.
- Design and operationalize Unity Catalog for data governance — access control, lineage, and security.
- Build monitoring and self-healing automation using Databricks-native AI and agentic capabilities.
- Drive CI/CD workflows for Databricks assets, setting DevOps best practices for deployment and release management.
- Lead design reviews and mentor Data Engineers on Databricks best practices and AI-native features.
- Own Databricks vendor coordination — case management, escalations, and release adoption strategy.
What Success Looks Like (First 6–12 Months)
- Within 6–12 months, you'll define the platform's tuning and governance standards, lead design reviews, mentor junior engineers, and shape the AI-native operations roadmap.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, or equivalent relevant experience.
- 6+ years of data engineering experience with 2+ years hands-on Databricks in enterprise settings.
- Deep understanding of Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and Workflow orchestration.
- Proven ability to tune Spark workloads for cost and performance at production scale.
- Advanced Python (PySpark) and SQL skills.
- Working knowledge of CI/CD practices and DevOps principles applied to data workloads.
- Experience with observability tooling for Databricks.
Preferred Qualifications:
- Experience with Databricks-native AI capabilities and agentic frameworks.
- Familiarity with Databricks Serverless Compute and DBSQL performance tuning.
- A Databricks Certified Professional.
- Exposure to Infrastructure-as-Code is a plus.
Competencies:
- Performance-engineering mindset — measures, tunes, and re-measures.
- Curiosity for AI-native operations and continuous automation.
- Strong sense of platform ownership — quality, cost, and reliability.
- Effective communication with engineering peers, vendors, and business stakeholders.
- Influence outcomes across source teams, vendors, and business stakeholders without direct authority.
Your next step
- Have your CV and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
- Ask the employer about the salary range before committing time to the process.
Complete your application on nxp.wd3.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Source & posting history
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Bangalore
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
- Status in our records
- Active
- First seen by us
- Aug 27, 2026
- Recorded sightings
- 114
- Last seen by us
- Oct 9, 2026
These dates show when we found the listing. Check the employer’s website to confirm it is still accepting applications.
Report an errorSee how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.