Location: Bengaluru, Karnataka, India
Job Type: Full-time
We are looking for an experienced Manager – Data Quality Engineering to lead a team responsible for ensuring the accuracy, completeness, reliability, and integrity of data across large-scale data platforms and pipelines.
Employment type in the employer’s posting: Full-time
Lead and mentor a team of data quality engineers across multiple pipelines
Integrate data quality testing into CI/CD pipelines
Lead root-cause analysis of complex data quality issues
From the employer’s posting
Lead and mentor a team of Data Quality Engineers supporting multiple data pipelines, platforms, and business domains.
Integrate data quality testing into CI/CD pipelines to enable reliable and continuous validation.
Drive root-cause analysis and resolution of complex data quality issues.
Education & alternatives
- Strong stakeholder management and communication skills, with the ability to work effectively across Data, Product, Engineering, and Analytics teams.
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- A strong ownership mindset with a passion for building scalable, reliable, and high-quality data systems.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
Databricks
Snowflake
Spark
Airflow
Where the posting names them
This role combines technical leadership, data quality engineering, test automation, and people management. You will work closely with Data Engineering, Analytics, Product, and other technology teams to establish robust validation strategies for complex ETL pipelines, data transformations, and business rules.
The ideal candidate brings strong hands-on expertise in Python, SQL, data quality automation, ETL validation, Snowflake, Databricks, Spark, and CI/CD, along with proven experience leading and developing engineering teams.
Requirements
- Strong experience validating complex ETL pipelines, data transformations, business logic, and large-scale data systems.
- Strong hands-on proficiency in Python and SQL, including analysis of large or terabyte-scale datasets.
- Solid understanding of data quality engineering, test automation, validation frameworks, and CI/CD practices.
- Define and execute data quality and automation strategies for complex ETL pipelines, transformations, and business rules.
- Develop scalable approaches for validating data across platforms such as Snowflake and Databricks.
- Drive the design, implementation, and continuous improvement of test automation frameworks and validation infrastructure.
- Integrate data quality testing into CI/CD pipelines to enable reliable and continuous validation.
- Support quality engineering across technologies such as Airflow, Spark, Databricks, and Snowflake.
- Drive root-cause analysis and resolution of complex data quality issues.
- Solid understanding of data quality engineering, test automation, validation frameworks, and CI/CD practices.
- Practical experience with technologies such as Snowflake, Databricks, Spark, and Airflow.
- Strong analytical and problem-solving skills with the ability to investigate complex data issues and identify root causes.
We are looking for an experienced Manager – Data Quality Engineering to lead a team responsible for ensuring the accuracy, completeness, reliability, and integrity of data across large-scale data platforms and pipelines.
This role combines technical leadership, data quality engineering, test automation, and people management. You will work closely with Data Engineering, Analytics, Product, and other technology teams to establish robust validation strategies for complex ETL pipelines, data transformations, and business rules.
The ideal candidate brings strong hands-on expertise in Python, SQL, data quality automation, ETL validation, Snowflake, Databricks, Spark, and CI/CD, along with proven experience leading and developing engineering teams.
Requirements
Key Responsibilities
Lead and mentor a team of Data Quality Engineers supporting multiple data pipelines, platforms, and business domains.
Define and execute data quality and automation strategies for complex ETL pipelines, transformations, and business rules.
Develop scalable approaches for validating data across platforms such as Snowflake and Databricks.
Drive the design, implementation, and continuous improvement of test automation frameworks and validation infrastructure.
Partner with Data Engineers, Analysts, Product Managers, and other stakeholders to ensure data accuracy, completeness, consistency, and integrity.
Analyze large-scale datasets to identify data anomalies, transformation errors, and business logic issues.
Establish engineering standards and best practices for data quality, testing, automation, and validation.
Integrate data quality testing into CI/CD pipelines to enable reliable and continuous validation.
Support quality engineering across technologies such as Airflow, Spark, Databricks, and Snowflake.
Drive root-cause analysis and resolution of complex data quality issues.
Establish metrics and processes to monitor data quality and improve reliability across critical data products.
Participate in Agile planning, technical discussions, architecture reviews, and cross-functional delivery.
Manage hiring, performance management, career development, and technical growth of team members.
Foster a culture of engineering excellence, accountability, collaboration, and continuous improvement.
What's Makes You a Great Fit
8+ years of hands-on experience in software testing, data quality engineering, data engineering, or a related technical discipline.
At least 2 years of experience in technical leadership or engineering management.
Strong experience validating complex ETL pipelines, data transformations, business logic, and large-scale data systems.
Strong hands-on proficiency in Python and SQL, including analysis of large or terabyte-scale datasets.
Solid understanding of data quality engineering, test automation, validation frameworks, and CI/CD practices.
Practical experience with technologies such as Snowflake, Databricks, Spark, and Airflow.
Strong analytical and problem-solving skills with the ability to investigate complex data issues and identify root causes.
Experience implementing quality engineering practices within Agile development environments.
Proven ability to build, mentor, and manage high-performing engineering teams.
Strong stakeholder management and communication skills, with the ability to work effectively across Data, Product, Engineering, and Analytics teams.
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
A strong ownership mindset with a passion for building scalable, reliable, and high-quality data systems.
Demand for Data Governance roles
New Data Governance postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Governance, by the work the posting describes.
Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.
Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.
A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.