Senior Technical Consultant (Data Engineer) - RDAF

We are looking for a Senior Technical Consultant – MFG with strong experience in data engineering, ETL pipelines, and cloud-based data platforms. The role involves designing and implementing data ingestion and transformation pipelines, collaborating with functional teams, and ensuring seamless data integration across multiple systems.

Key Responsibilities

Advanced Execution & Data Management

• Manage and execute complex project tasks related to data ingestion, transformation, validation, and publishing.

• Review and analyze data provided by customers, understanding its technical and functional intent along with dependencies.

• Work closely with functional teams to understand end-to-end data flows and integration requirements.

Data Integration & Pipeline Development

• Build and maintain data ingestion and egress pipelines capable of handling large volumes of data.

• Develop data transformation functions using technologies such as Python, PySpark, SQL, and SSIS.

• Integrate data from various sources including Teradata, SAP ERP, SQL Server, Oracle, Sybase, ODBC connectors, and flat files using API or batch integrations.

Production Deployment & Hypercare

• Support production deployment activities.

• Assist in issue triaging, testing, and root cause analysis.

• Resolve batch automation disruptions in a timely manner to ensure customer SLA compliance and accurate data delivery.

Technical Leadership

• Provide technical guidance to junior consultants and review their code to ensure alignment with best practices and quality standards.

• Follow and promote o9 ways of working and industry standards for efficient project execution.

Required Skills & Qualifications

• 3+ years of experience in Data Architecture, Data Engineering, or related fields.

• Strong experience in data modelling, ETL processes, and cloud-based data platforms.

• Hands-on experience with:

  • Python

  • PySpark

  • SQL

• Experience with workflow management tools such as Airflow and SSIS.

• Experience working with Parquet, JSON, RESTful APIs, HDFS, Delta Lake, and query frameworks such as Hive and Presto.

• Strong SQL expertise, including query writing and working with relational databases.

• Experience with version control platforms such as GitHub or Azure DevOps.

• Familiarity with Agile development methodologies.

• Strong problem-solving skills and a proactive learning mindset.

• Excellent verbal and written communication skills.

Good to Have

• Hands-on experience with Delta Lake.

• Experience working with Supply Chain Planning applications.

• Exposure to cloud platforms such as AWS, Azure, or Google Cloud.