Back to jobs

Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Refactor SQL Server stored procedures and ETL into Spark-based ELT pipelines in Fabric

  • Build and maintain bronze, silver and gold layers in Microsoft Fabric and Databricks

  • Implement incremental loading and change data capture from on-prem SQL

  • Design semantic models and star schemas for Power BI reporting

  • Validate output consistency between legacy and modernized pipelines

From the employer’s posting
Refactor SQL-based transformations into scalable Spark-based ELT pipelines in Fabric.
Build and maintain bronze, silver, and gold layers in Microsoft Fabric and Databricks.
Implement incremental loading and change data capture patterns from on-prem SQL to Fabric or Databricks.
Engineer star schemas and dimensional models for high-performance Power BI reporting.
Validate output consistency between legacy and modernized pipelines.
Apply at Investec

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
5
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Investec is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • T-SQL
  • Azure
  • Databricks
  • Delta Lake
  • Power BI
  • Spark
  • SQL Server
  • Airflow
  • PySpark
Where the posting names them
- Proven experience refactoring legacy SQL-based ETL workloads into scalable, modern ELT pipelines. Practical experience working with Microsoft Fabric and Lakehouse architecture principles. - Hands-on experience with Spark (PySpark preferred) for distributed data transformation, Python notebooks. - Solid understanding of dimensional modeling, including star schema and Kimball-based methodologies.
At Investec, we do things differently. We're a leading international bank and wealth manager built on a culture of curiosity, entrepreneurial spirit and human connection. Ideas are heard, ambition is celebrated, and impact is encouraged. As part of a team that challenges convention and strives for outperformance, you'll help shape bold solutions for clients who expect something more than the ordinary. We are seeking a highly skilled Data Engineer to engineer and deliver domain-aligned data products within a centrally governed Microsoft Data Platforms. Working within established standards, CI/CD templates, and defined data contracts, the Data Engineer will modernize SQL-driven legacy workloads and re-engineer them into scalable Spark-based Lakehouse datasets and semantic models. The focus is on execution: extracting embedded business logic from on-prem SQL systems, implementing robust data pipelines, and delivering reliable, high-quality data products that support analytics, reporting, and AI use cases. Roles and Responsibilities:
We are seeking a highly skilled Data Engineer to engineer and deliver domain-aligned data products within a centrally governed Microsoft Data Platform. Working within established standards, CI/CD templates, and defined data contracts, the Data Engineer will modernize SQL-driven legacy workloads and re-engineer them into scalable Spark-based Lakehouse datasets and semantic models. The focus is on execution: extracting embedded business logic from on-prem SQL systems, implementing robust data pipelines, and delivering reliable, high-quality data products that support analytics, reporting, and AI use cases.
Working within established standards, CI/CD templates, and defined data contracts, the Data Engineer will modernize SQL-driven legacy workloads and re-engineer them into scalable Spark-based Lakehouse datasets and semantic models. The focus is on execution: extracting embedded business logic from on-prem SQL systems, implementing robust data pipelines, and delivering reliable, high-quality data products that support analytics, reporting, and AI use cases. Data products are treated as managed assets — version-controlled, tested, monitored, and continuously improved to meet defined quality and performance expectations.
Key Responsibilities: SQL Modernization & Legacy Refactoring - Maintain and enhance existing SQL Server workloads (stored procedures, views, ETL processes).
SQL Modernization & Legacy Refactoring - Maintain and enhance existing SQL Server workloads (stored procedures, views, ETL processes). - Refactor SQL-based transformations into scalable Spark-based ELT pipelines in Fabric.
- Maintain and enhance existing SQL Server workloads (stored procedures, views, ETL processes). - Refactor SQL-based transformations into scalable Spark-based ELT pipelines in Fabric. - Translate dimensional models from legacy Kimball-based marts into modern Lakehouse structures.
- Spark (PySpark preferred) - Implement incremental loading and change data capture patterns from on-prem SQL to Fabric or Databricks. - Optimize Delta tables for performance and cost efficiency.
Hybrid Data Operations - Implement secure and reliable data movement between on-prem SQL environments and Fabric/Azure DataFactory. - Support parallel run states during migration phases.
Core Skills and Knowledge: - 6+ years of hands-on experience in data engineering within SQL-heavy or enterprise data environments. - Strong expertise in Microsoft SQL Server and advanced T-SQL development, including query optimization and performance tuning.
- 6+ years of hands-on experience in data engineering within SQL-heavy or enterprise data environments. - Strong expertise in Microsoft SQL Server and advanced T-SQL development, including query optimization and performance tuning. - Proven experience refactoring legacy SQL-based ETL workloads into scalable, modern ELT pipelines. Practical experience working with Microsoft Fabric and Lakehouse architecture principles.
- Strong expertise in Microsoft SQL Server and advanced T-SQL development, including query optimization and performance tuning. - Proven experience refactoring legacy SQL-based ETL workloads into scalable, modern ELT pipelines. Practical experience working with Microsoft Fabric and Lakehouse architecture principles. - Hands-on experience with Spark (PySpark preferred) for distributed data transformation, Python notebooks.
- Contribute to documentation and structured decommissioning of legacy workloads. Azure Infrastructure as Code & DevOps - Understanding and hands-on experience with Azure Bicep templates for automating infrastructure and pipeline deployments.
Azure Infrastructure as Code & DevOps - Understanding and hands-on experience with Azure Bicep templates for automating infrastructure and pipeline deployments. - Experience with source control, preferably Git.
- Experience implementing CI/CD processes and infrastructure automation, including automated deployment pipelines using Infrastructure as Code (IaC). - Knowledge of Azure services such as Stream Analytics, Logic Apps, Function Apps, and Event Hubs would be an added advantage. -
- Solid understanding of dimensional modeling, including star schema and Kimball-based methodologies. - Experience in Azure Data Factory, Databricks, MS Fabric, ADLS Gen2 , Databricks , Spark , Airflow, purview. - Experience designing and optimizing semantic models for enterprise analytics platforms such as Power BI.
Preferred Qualificaions: · Microsoft certifications (Azure Data Engineer or Fabric Data Engineer Associate). · Experience in distributed data processing environments.
- Support phased migration and controlled decommissioning of legacy assets. Lakehouse Engineering in Microsoft Fabric and Databricks(Unity Catalog) - Build and maintain bronze, silver, and gold layers in Microsoft Fabric and Databricks.
Lakehouse Engineering in Microsoft Fabric and Databricks(Unity Catalog) - Build and maintain bronze, silver, and gold layers in Microsoft Fabric and Databricks. - Develop ingestion and transformation pipelines using:
AI SDLC · Basic knowledge of using AI tools to accelerate the build and development process across the data lifecycle, e.g. GitHub Copilot, Codex, Claude and Databricks Genie. · Using AI skills and agents to automate development processes, such as scaffolding project folders, creating user stories and acceptance criteria, and generating pull requests.
- Implement incremental loading and change data capture patterns from on-prem SQL to Fabric or Databricks. - Optimize Delta tables for performance and cost efficiency. - Ensure datasets align with defined data contracts and platform standards.
- Design and optimize semantic models in Fabric for enterprise analytics. - Engineer star schemas and dimensional models for high-performance Power BI reporting. - Ensure validated KPIs and business rules are consistently implemented.
- Experience in Azure Data Factory, Databricks, MS Fabric, ADLS Gen2 , Databricks , Spark , Airflow, purview. - Experience designing and optimizing semantic models for enterprise analytics platforms such as Power BI. - Experience implementing incremental loading and change data capture (CDC) patterns in hybrid environments.
- Notebooks - Spark (PySpark preferred) - Implement incremental loading and change data capture patterns from on-prem SQL to Fabric or Databricks.

Your next step

Complete your application on careers.investec.co.uk. The employer’s form will show what is required.

Already applied? Track this application

Has Investec posted this job before?

Yes. We’ve followed 2 other Data Engineer jobs there since November 2026. All 2 are still up.

  1. MumbaiStill up after 4 days, first seen Nov 18
  2. MumbaiStill up after 4 days, first seen Nov 18
  3. This jobUp 4 days so far, first seen Nov 18

Job description

View original posting ↗

Investec – Where Out of the Ordinary Happens

At Investec, we do things differently. We're a leading international bank and wealth manager built on a culture of curiosity, entrepreneurial spirit and human connection. Ideas are heard, ambition is celebrated, and impact is encouraged. As part of a team that challenges convention and strives for outperformance, you'll help shape bold solutions for clients who expect something more than the ordinary.

We are seeking a highly skilled Data Engineer to engineer and deliver domain-aligned data products within a centrally governed Microsoft Data Platforms. Working within established standards, CI/CD templates, and defined data contracts, the Data Engineer will modernize SQL-driven legacy workloads and re-engineer them into scalable Spark-based Lakehouse datasets and semantic models. The focus is on execution: extracting embedded business logic from on-prem SQL systems, implementing robust data pipelines, and delivering reliable, high-quality data products that support analytics, reporting, and AI use cases.

Roles and  Responsibilities:

 

We are seeking a highly skilled Data Engineer to engineer and deliver domain-aligned data products within a centrally governed Microsoft Data Platform.

Working within established standards, CI/CD templates, and defined data contracts, the Data Engineer will modernize SQL-driven legacy workloads and re-engineer them into scalable Spark-based Lakehouse datasets and semantic models.

The focus is on execution: extracting embedded business logic from on-prem SQL systems, implementing robust data pipelines, and delivering reliable, high-quality data products that support analytics, reporting, and AI use cases.

Data products are treated as managed assets — version-controlled, tested, monitored, and continuously improved to meet defined quality and performance expectations.

Key Responsibilities:

SQL Modernization & Legacy Refactoring

  • Maintain and enhance existing SQL Server workloads (stored procedures, views, ETL processes).
  • Refactor SQL-based transformations into scalable Spark-based ELT pipelines in Fabric.
  • Translate dimensional models from legacy Kimball-based marts into modern Lakehouse structures.
  • Support phased migration and controlled decommissioning of legacy assets.

Lakehouse Engineering in Microsoft Fabric and Databricks(Unity Catalog)

  • Build and maintain bronze, silver, and gold layers in Microsoft Fabric and Databricks.
  • Develop ingestion and transformation pipelines using:
    • Notebooks
    • Spark (PySpark preferred)
  • Implement incremental loading and change data capture patterns from on-prem SQL to Fabric or Databricks.
  • Optimize Delta tables for performance and cost efficiency.
  • Ensure datasets align with defined data contracts and platform standards.

Semantic Modeling & Analytics Enablement

  • Design and optimize semantic models in Fabric for enterprise analytics.
  • Engineer star schemas and dimensional models for high-performance Power BI reporting.
  • Ensure validated KPIs and business rules are consistently implemented.
  • Balance performance, usability, and maintainability in semantic design.

Data Product Ownership

  • Engineer data products that are reliable, discoverable, and consumption ready.
  • Apply testing and validation to ensure data quality and integrity.
  • Monitor pipeline health and performance using platform-defined observability standards.
  • Contribute to continuous improvement of data products based on usage and feedback.
  • Collaborate closely with business stakeholders, analysts, and the central Data Platform team.

Hybrid Data Operations

  • Implement secure and reliable data movement between on-prem SQL environments and Fabric/Azure DataFactory.
  • Support parallel run states during migration phases.
  • Validate output consistency between legacy and modernized pipelines.
  • Contribute to documentation and structured decommissioning of legacy workloads.

Azure Infrastructure as Code & DevOps

  • Understanding and hands-on experience with Azure Bicep templates for automating infrastructure and pipeline deployments.
  • Experience with source control, preferably Git.
  • Experience implementing CI/CD processes and infrastructure automation, including automated deployment pipelines using Infrastructure as Code (IaC).
  • Knowledge of Azure services such as Stream Analytics, Logic Apps, Function Apps, and Event Hubs would be an added advantage.
  •  

AI SDLC

·       Basic knowledge of using AI tools to accelerate the build and development process across the data lifecycle, e.g. GitHub Copilot, Codex, Claude and Databricks Genie.

·       Using AI skills and agents to automate development processes, such as scaffolding project folders, creating user stories and acceptance criteria, and generating pull requests.

 

 

Core Skills and Knowledge:

  • 6+ years of hands-on experience in data engineering within SQL-heavy or enterprise data environments.
  • Strong expertise in Microsoft SQL Server and advanced T-SQL development, including query optimization and performance tuning.
  • Proven experience refactoring legacy SQL-based ETL workloads into scalable, modern ELT pipelines.
    Practical experience working with Microsoft Fabric and Lakehouse architecture principles.
  • Hands-on experience with Spark (PySpark preferred) for distributed data transformation, Python notebooks.
  • Solid understanding of dimensional modeling, including star schema and Kimball-based methodologies.
  • Experience in Azure Data Factory, Databricks, MS Fabric, ADLS Gen2 , Databricks , Spark , Airflow, purview.
  • Experience designing and optimizing semantic models for enterprise analytics platforms such as Power BI.
  • Experience implementing incremental loading and change data capture (CDC) patterns in hybrid environments.
  • Experience building production-grade data pipelines with testing, monitoring, and CI/CD integration.
  • Strong understanding of data governance principles, data contracts, and structured engineering standards.
  • Experience working in enterprise-scale or regulated environments with disciplined delivery practices.
  • Knowledge of web analytics platforms such as Adobe Analytics, Google Analytics, and Firebase would be an added advantage.

Desirable Skills : Any financial services / banking / capital market experience

Preferred Qualificaions:

·       Microsoft certifications (Azure Data Engineer or Fabric Data Engineer Associate).

·       Experience in distributed data processing environments.

·       Exposure to AI/ML data preparation workflows.

Experience in enterprise-scale or regulated environments.

 

 

 

 

As part of our collaborative & agile culture, our working week is 4 days in the office and one day remote. We believe that being together enables us to live our values and support our clients and communities in an extraordinary way.

 

 

Embedded in our culture is a sense of belonging and inclusion. At Investec we want everyone to find it easy to be themselves, and to feel they belong. It's a responsibility we all share and is integral to our purpose and values as an organisation. We believe that innovation thrives when everyone feels respected, included, and empowered to contribute.

We actively seek out diverse talent and foster an inclusive environment, encouraging applications from people of all backgrounds and experiences. Here, you'll find networks, benefits, and development opportunities designed to support your career journey, wherever it may lead.

If this role excites you but you don't meet every requirement, we'd still love to hear from you. Your unique perspective and experience could be exactly what we are looking for.  Get in touch!

At Investec, we're deeply invested in our clients, our colleagues, and our communities. It's more than a mindset; it's how we show up every day.

Be part of something Out of the Ordinary.

Recite Me

We commit to ensure that everyone is fairly assessed during our recruitment process. To assist candidates in completing their application form, Recite Me assistive technology is available on our Careers pages. This can be accessed by clicking on the ‘Accessibility Options' link at the top of the page.

The Recite Me tool includes a screen reader, styling and customisation options, a series of reading aids, a translator and more.

If you have any form of disability or neurodivergent need and require further assistance in completing your application, please contact the Careers team at [email protected] who will be happy to assist. 


 

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Mumbai

- Collaborate closely with business stakeholders, analysts, and the central Data Platform team. Hybrid Data Operations - Implement secure and reliable data movement between on-prem SQL environments and Fabric/Azure DataFactory.
More source context
- Experience designing and optimizing semantic models for enterprise analytics platforms such as Power BI. - Experience implementing incremental loading and change data capture (CDC) patterns in hybrid environments. - Experience building production-grade data pipelines with testing, monitoring, and CI/CD integration.

More relevant text appears in the full description.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.