← back to jobs
> job detail
W
👽Other

Data Operation Engineer

WPP · Chennai, Tamil Nadu, India
// classified as
Other (Adjacent or hard to classify.)
posted
<1d ago
location
Chennai, Tamil Nadu, India
languages
python, sql
tools
azure, databricks, dbt
> stack
pythonsqlazuredatabricksdbtterraformdbt
> description
<div class="content-intro"><p><strong>WPP is the trusted growth partner for the world’s leading brands.&nbsp;</strong></p> <p><strong>We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic marketing platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth.&nbsp;</strong><br><strong>&nbsp;</strong><br><strong>We have been building the world's most valuable brands for 50 years and have global reach across 100+ markets, with deep local expertise.</strong><br><strong>&nbsp;</strong><br><strong>Our people are the key to our success. We're committed to fostering a culture of creativity, belonging and continuous learning, attracting and developing the brightest talent, and providing exciting career opportunities that help our people grow.&nbsp;</strong><br><strong>&nbsp;</strong><br><strong>For more information, visit <a href="https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwpp.com%2F&amp;data=05%7C02%7CErica.Durr%40wpp.com%7C9bf4566a65bc46a48ac008de749116ea%7C150b5e663d884dee83f6ed149b727a00%7C0%7C0%7C639076363668176216%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&amp;sdata=Q9juosud56XGLThSFZ1NpPZd6FXpJPxV74OeRZWoh%2B4%3D&amp;reserved=0" target="_blank">WPP.com.</a></strong><br><strong>&nbsp;</strong></p></div><p><span style="text-decoration: underline;"><strong>Why we're hiring:</strong></span></p> <p>WPP Media is embarking on a transformative data journey through&nbsp;<strong>Databridge&nbsp;</strong>- our internal data integration framework - designed to unify our fragmented global data landscape. We are moving from isolated, market-specific implementations to a standardized, scalable, cloud-agnostic, and AI-ready data platform built on a modern tech stack:&nbsp;<strong>dbt, Databricks, Python (dlthub), and GitHub Actions.</strong></p> <p>As a&nbsp;<strong>Data Operations Engineer</strong>, you will be a foundational member of our new Data Integration &amp; Operations team in Chennai. You will be the&nbsp;<strong>bridge between development and production</strong>, ensuring data pipelines are delivered reliably, consistently, and securely across global markets.</p> <p>This is a&nbsp;<strong>hands-on technical role</strong> focused on operationalizing, automating, and monitoring data workflows. You will implement CI/CD for data pipelines, enforce data quality standards, manage production deployments, respond to incidents, and continuously improve data delivery.</p> <p><span style="text-decoration: underline;"><strong>What you'll be doing:</strong></span></p> <ul> <li><strong>CI/CD Implementation &amp; Automation</strong> <ul> <li>Build and maintain automated CI/CD pipelines for data workflows using&nbsp;<strong>GitHub Actions</strong>and&nbsp;<strong>Databricks Asset Bundles</strong></li> <li>Implement automated testing gates including code quality checks, data quality validation, and pre-commit hooks</li> <li>Configure and manage multiple environments with proper isolation and access controls</li> <li>Automate deployment processes ensuring repeatable, zero-touch releases</li> </ul> </li> <li><strong>Data Pipeline Operations &amp; Monitoring</strong> <ul> <li>Monitor daily execution of&nbsp;<strong>Databricks Jobs/Workflows</strong>, tracking pipeline health, data quality, and SLA compliance</li> <li>Set up comprehensive alerting and notifications for failures, SLA breaches, and cost anomalies</li> <li>Use monitoring dashboards to proactively identify and resolve issues</li> <li>Perform regular health checks on production data products</li> </ul> </li> <li><strong>Data Quality &amp; Governance</strong> <ul> <li>Enforce platform-wide data quality standards by creating reusable test macros and validation patterns</li> <li>Review Data Engineer code for proper test coverage, documentation, and adherence to standards</li> <li>Support&nbsp;<strong>Databricks Unity Catalog</strong>integration for metadata management, lineage tracking, and access control</li> </ul> </li> <li><strong>Production Deployment &amp; Incident Management</strong> <ul> <li>Own production deployment workflows and manage&nbsp;<strong>Databricks Jobs</strong>configurations</li> <li>Maintain version-controlled job definitions in Git for Infrastructure as Code</li> <li>Act as first responder for production incidents, performing triage and root cause analysis</li> <li>Use operational runbooks to diagnose and resolve common issues</li> <li>Escalate to Data Engineers or DevOps when needed and document incidents with detailed RCA</li> <li>Participate in on-call rotation for operational coverage</li> </ul> </li> <li><strong>Documentation &amp; Continuous Improvement</strong> <ul> <li>Create and maintain operational runbooks detailing schedules, troubleshooting steps, escalation paths, and recovery procedures</li> <li>Document standards, guidelines, and workflows in&nbsp;<strong>Confluence</strong></li> <li>Contribute to the&nbsp;<strong>Central Data Solution Repository</strong>with reusable templates and patterns</li> <li>Analyze incident trends and participate in retrospectives to drive platform optimization</li> </ul> </li> </ul> <p><span style="text-decoration: underline;"><strong>What you'll need:</strong></span></p> <ul> <li><strong>Experience</strong> <ul> <li><strong>5+ years</strong>of hands-on experience in data operations, data engineering, or platform engineering</li> <li>Proven track record supporting production data pipelines and operational workflows</li> </ul> </li> <li><strong>Technical Expertise</strong> <ul> <li><strong>Databricks Platform:</strong> <ul> <li>Practical experience with&nbsp;<strong>Databricks SQL Warehouses</strong>,&nbsp;<strong>Jobs/Workflows</strong>, and&nbsp;<strong>CLI</strong></li> <li>Understanding of&nbsp;<strong>Unity Catalog</strong>for governance, access control, and lineage</li> <li>Knowledge of&nbsp;<strong>Delta Lake</strong>and performance tuning</li> <li>Familiarity with&nbsp;<strong>Databricks Asset Bundles</strong>for Infrastructure as Code</li> </ul> </li> </ul> </li> </ul> <ul> <li> <ul> <li><strong>Data Transformation Pipeline - Operational Proficiency:</strong> <ul> <li>Strong working knowledge of&nbsp;<strong>SQL-based transformation frameworks</strong>for operational purposes (e.g., dbt, Dataform, SQLMesh, or orchestrated transformation pipelines)</li> <li>Understanding transformation project structure, dependency management, testing frameworks, and documentation standards</li> <li>Reading and understanding SQL transformations for validation and troubleshooting</li> <li>Running transformation commands/workflows for CI/CD and production operations</li> <li>CI/CD integration, environment management, and automated deployment</li> <li>Troubleshooting production transformation pipeline issues using logs and error messages</li> <li>Production experience with data quality testing and validation at scale</li> </ul> </li> </ul> </li> </ul> <ul> <li> <ul> <li><strong>CI/CD &amp; Automation:</strong> <ul> <li>Proficiency with&nbsp;<strong>GitHub Actions</strong>including workflows, secrets management, and environment configuration</li> <li>Understanding of Git workflows and code review processes</li> <li>Familiarity with pre-commit hooks, linting, and automated testing</li> <li>Basic knowledge of Infrastructure as Code principles</li> </ul> </li> </ul> </li> </ul> <ul> <li> <ul> <li><strong>Python &amp; SQL:</strong> <ul> <li>Proficient in&nbsp;<strong>Python</strong>for scripting and automation (experience with&nbsp;<strong>dlthub</strong>&nbsp;is a plus)</li> <li>Strong&nbsp;<strong>SQL</strong>skills for data validation and troubleshooting</li> <li>Ability to read and understand complex data transformation logic</li> </ul> </li> </ul> </li> </ul> <ul> <li> <ul> <li><strong>Cloud &amp; Operational Skills:</strong> <ul> <li>Solid understanding of core cloud services in Azure and/or GCP</li> <li>Experience with production monitoring, alerting, and incident response</li> <li>Understanding of SLA management and operational metrics</li> <li>Strong problem-solving skills for diagnosing distributed system issues</li> <li>Excellent communication and documentation skills</li> <li>Detail-oriented with commitment to operational excellence</li> </ul> </li> </ul> </li> </ul> <ul> <li><strong>Preferred Skills</strong> <ul> <li>Production operational experience with dbt Core (our primary transformation framework) including project structure, models, tests, macros, and CLI operations</li> <li>Understanding of FinOps practices for cloud cost optimization</li> <li>Exposure to Power BI or similar BI tools</li> <li>Experience with Terraform or other Infrastructure as Code tools</li> <li>Familiarity with Confluence and Jira</li> </ul> </li> </ul> <p><span style="text-decoration: underline;"><strong>Who you are:</strong></span></p> <p><strong>You're open<em>:</em> </strong>We are inclusive and collaborative; we encourage the free exchange of ideas; we respect and celebrate diverse views. We are open-minded: to new ideas, new partnerships, new ways of working.</p> <p><strong>You're optimistic<em>:</em></strong> <span id="628d56ad5d8a35dab853e65d9daa237c" class="editor-module-hl-green-solid">We believe</span> in the power of creativity, technology and talent to create brighter futures or our people, our clients and our communities. We approach all that we do with conviction: to try the new and to seek the unexpected.</p> <p><strong>You're extraordinary:</strong> we are stronger together: through collaboration we achieve the amazing. We are creative leaders and pioneers of our industry; we provide extraordinary every day.</p> <p>&nbsp;</p> <p><span style="text-decoration: underline;"><strong>What we'll give you:</strong></span></p> <p><strong>Passionate, inspired people</strong> – We aim to create a culture in which people can do extraordinary work.</p> <p><strong>Scale and opportunity</strong> – We offer the opportunity to create, influence and complete projects at a scale that is unparalleled in the industry.</p> <p><strong>Challenging and stimulating work</strong> – Unique work and the opportunity to join a group of creative problem solvers. Are you up for the challenge?</p> <p>&nbsp;</p><div class="content-conclusion"><p><strong>We believe the best work happens when we're together, fostering creativity, collaboration, and connection. That's why we’ve adopted a hybrid approach, with teams in the office around four days a week. If you require accommodations or flexibility, please discuss this with the hiring team during the interview process.</strong></p> <p><strong>WPP is an equal opportunity employer and considers applicants for all positions without discrimination or regard to particular characteristics. We are committed to fostering a culture of respect in which everyone feels they belong and has the same opportunities to progress in their careers.</strong></p> <h4><strong>Please read our Privacy Notice (<a href="https://www.wpp.com/en/careers/wpp-privacy-policy-for-recruitment">https://www.wpp.com/en/careers/wpp-privacy-policy-for-recruitment</a>) for more information on how we process the information you provide.</strong></h4></div>