CPW Data Engineer II
India is among the top ten priority markets for General Mills, and hosts our Global Shared Services Centre. This is the Global Shared Services arm of General Mills Inc., which supports its operations worldwide. With over 1,300 employees in Mumbai, the center has capabilities in the areas of Supply Chain, Finance, HR, Digital and Technology, Sales Capabilities, Consumer Insights, ITQ (R&D & Quality), and Enterprise Business Services. Learning and capacity-building is a key ingredient of our success.
Position Title
CPW Data Engineer II
Function/Group
Insights & AnalyticsĀ
Location
Mumbai
Shift Timing
11.00 AM ā 8.00 PM
Role Reports to
Manager
Remote/Hybrid/in-Office
Hybrid
Ā
CPW is a JV between 2 of the biggest and the largest food organizations in the world i.e. General Mills & Nestle. Working in CPW, you can get the best of both the worlds. We have the power of the big and the agility of the small. CPW by far helps build skills that are cutting edge and sets industry benchmarks. CPW is a pioneer in partnering with technological startups, implementing advanced processes and creating technical/analytical footprints in the industry. Here is your chance to learn, grow and contribute with this exciting team.
Ā
Job Responsibilities :
- Building data assets that is best suited and an edge above in the industry
- Data Governance & Stewardship : Maintain data quality , deploy right validation metrics to ensure precise and accurate data flow, enhancement of data quality and maintain data security across all users.
- Data Pipeline Development: Design and develop robust ETL/ELT pipelines using tools like Azure Databricks and PySpark. Build and maintain bronze, silver, and gold layer data architectures. Implement incremental processing, deduplication, and performance optimization
- Data Harmonization : Understand the current set-up and work with the team/business partners to optimize and automate the processes maintaining a good balance of speed vs perfection. Re-look at the existing data models and identify sustainable and scalable approaches for improving the data usage in analytics.
- Data Integration & Modeling: Integrate data from multiple sources (e.g., Nielsen, Circana, internal systems). Develop scalable data models for reporting and analytics use cases. Ensure consistency in dimensions like product, period, and market hierarchies. Optimize queries, storage formats (Delta), and pipeline performance
- Integrate New Data Assets : Build good understanding of new datasets, including panel data, RMS data and other data sources and set-up processes to integrate it into the existing data environment.
- Support Data Engineering needs : Understand data needs from the stakeholders & internal teams and implement data transformation/manipulation to help get answers to Business questions faster and smarter. Support the Reporting and Visualization team on backend data architecture and data model development for new projects.
- Performance & Optimization: Optimize queries, storage formats (Delta), and pipeline performance and ensure scalability and cost-efficiency of data workflows
Desired Profile :Ā
Ā
Minimum Degree Requirements: Bachelors
Preferred Degree Requirements: Masters
Preferred Major Area of Study:BT ech / Mtech degrees in Computer Science, IT, Electronics& Telecommunications / degree in relevant fields of study
Ā
Experience :Ā
Ā
Minimum years of related experience required:Ā Prior experience of working on Data Lakes is a must and experience of working with variety of data sources ā FMCG preferred
Preferred years of related experience: 7+ years Data Engineering experience
Ā
Skills Needed :
- Knowledge of Data warehouse and Business Intelligence Platforms
- Experience with Delta Lake architecture and large-scale data processing
- Understanding of data warehousing concepts and ETL frameworks
- Knowledge of developing Business Intelligence Platforms / 360 degree view of data
- Prior experience working with variety of data sources - FMCG preferred
- Good effective communication skills
- Good Stakeholder managementĀ
Competencies/Behaviors required for job :Ā
Leading Change
- Continuous Improvement mindset
- Stakeholder communication and ownership mindset
- Remains curious despite having developed deep expertise
- Delivers Outstanding Results
- Thinks through ways of implementing his/hers knowledge/experience which the process could benefit from
- Attention to detail with a focus on data accuracy and reliability
- Ability to handle ambiguous data issues and drive resolution
- Makes quality decisions in a timely manner
- Proactively anticipates and addresses data issues/opportunities
- Consistently accomplishes assigned tasks
- Delivers high quality work within established timeframes
- Seeks assistance, information and resources to make good decisions
Technical Expertise :
- Adapts to tools & technology as per the process needs
- Strong expertise on SQL, Pyspark, Azure Databricks, Azure Datafactory is a must
- Experience in other Azure services like Azure Storage account, Azure key vault and Azure Devops is desirable
- Familiarity with data governance and security frameworks
- Acquires foundational knowledge and skills in his/her functional area
- Seeks to understand the principles of service excellence & how to apply them in own area
Influence and Impact :Ā
- Maintain good working relationship with peer group delivering as a Team
- Set examples in the peer groupĀ
Ā
COMPANY OVERVIEW
We exist to make food the world loves. But we do more than that. Our company is a place that prioritizes being a force for good, a place to expand learning, explore new perspectives and reimagine new possibilities, every day. We look for people who want to bring their best ā bold thinkers with big hearts who challenge one other and grow together.Ā Because becoming the undisputed leader in food means surroundingĀ ourselves with peopleĀ who are hungry for whatās next.
Ā