Back to jobs

Data Engineer

Bristol, United Kingdom

Live, first seen by us 78 days ago
Pay
£53,000–67,000/year — pay source
Compensation £53,000 - £67,000 / year Employment type
Read the full posting
Work setting
Not stated
Employment
Permanent — employment source
Employment type Permanent - Full Time
Read the full posting

What you’ll work on

Full posting
  • Design, build and maintain scalable data pipelines for real-time and batch processing

  • Create data models and lakehouse architectures for analytics, reporting and ML

  • Automate and monitor data workflows with Databricks Workflows and Azure Monitor

  • Implement data quality, security and governance controls, including lineage

  • Work with Pricing, Underwriting, Data Science and Technology teams on data solutions

From the employer’s posting
Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing.
Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor.
Implement data security and governance frameworks, including access controls, data lineage and sensitive data protection.
Collaborate with stakeholders across Pricing, Underwriting, Data Science and Technology to deliver data-driven business solutions.

What you’ll bring

All qualifications

Core experience

  • Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake.
  • Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming.
  • Knowledge of data warehousing, lakehouse architectures and dimensional modelling.
  • Experience delivering scalable, high-quality data solutions to support analytics, reporting and machine learning.
  • Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs.
  • Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code.
Qualification wording
Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake.
Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming.
Knowledge of data warehousing, lakehouse architectures and dimensional modelling.
Experience delivering scalable, high-quality data solutions to support analytics, reporting and machine learning.
Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs.
Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code.

Benefits in the posting

Full benefits wording
  • 25 days annual leave, rising to 27 days over 2 years’ service and 30 days after 5 years’ service. Plus bank holidays!
  • Discretionary annual bonus
  • Pension scheme – 5% employee, 6% employer

From the employer’s posting.

Apply at Sbgl

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 5, 202678 days ago
Recorded sightings
35
Last seen by us
Nov 22, 2026
Reposted
once since Aug 20, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.

How this job compares

Time since we first saw it

Day 78

Up longer than most. Similar jobs usually come down between day 6 and day 56.

Well past Sbgl’s usual: its jobs come down by about day 29.

From 14,771 similar postings that came down, and 6 of Sbgl’s. Coming down is not always a hire.

Sbgl is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Takes jobs down at a usual pace
  • 50% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Scala
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Kafka
  • Power BI
  • PySpark
Where the posting names them
- Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake. - Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation. - Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming.
Desirable - Experience with Scala. - Exposure to MLOps, feature stores and machine learning platforms.
At Somerset Bridge Group, we're transforming our data platform to create a modern, cloud-based data ecosystem that powers smarter decision-making across the business. As part of this journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team, you'll play a key role in designing, building and optimising scalable data solutions that support Pricing, Underwriting, Claims and wider business operations. Working with large and complex datasets, you'll develop robust data pipelines and platforms that enable analytics, reporting, machine learning and AI-driven initiatives across the organisation.
Joining our Enterprise Data Team, you'll play a key role in designing, building and optimising scalable data solutions that support Pricing, Underwriting, Claims and wider business operations. Working with large and complex datasets, you'll develop robust data pipelines and platforms that enable analytics, reporting, machine learning and AI-driven initiatives across the organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance and security controls, optimising cloud-based data infrastructure, and supporting both real-time and batch data processing. Working closely with Data Architects, Analysts, Pricing teams and Technology colleagues, you'll help shape the future of SBG's enterprise data platform, delivering scalable, secure and efficient solutions that support strategic business objectives and regulatory requirements.
Working closely with Data Architects, Analysts, Pricing teams and Technology colleagues, you'll help shape the future of SBG's enterprise data platform, delivering scalable, secure and efficient solutions that support strategic business objectives and regulatory requirements. This is an exciting opportunity to join a growing Enterprise Data Team and make a significant impact on the development of a modern Azure-based data platform, helping to drive data-led innovation across the business. What you'll be responsible for:
What you'll be responsible for: - Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing. - Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability and cost efficiency.
- Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing. - Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability and cost efficiency. - Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
- Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives. - Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor. - Ensure data quality, integrity and governance through effective controls, security standards and regulatory compliance.
- Implement data security and governance frameworks, including access controls, data lineage and sensitive data protection. - Drive continuous improvement by adopting new technologies and best practices across the Azure and Databricks ecosystem. What you'll need:
What you'll need: - Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake. - Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation.
- Experience delivering scalable, high-quality data solutions to support analytics, reporting and machine learning. - Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs. - Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code.
- Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs. - Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code. - Strong understanding of data governance, security and access controls, including Unity Catalog and Purview.
- Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation. - Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming. - Knowledge of data warehousing, lakehouse architectures and dimensional modelling.

Your next step

Complete your application on vacancies.somersetbridgegroup.com. The employer’s form will show what is required.

Applying through Pinpoint

  • Only .pdf and .docx are accepted. Older .doc files are turned away.

Already applied? Track this application

Has Sbgl posted this job before?

Yes. We’ve followed 2 other Data Engineer jobs there since August 2026. One came down after 3 days. One is still up.

  1. BristolCame down after 3 days, first seen Aug 20
  2. Newcastle Upon TyneStill up after 78 days, first seen Sep 5
  3. This jobUp 78 days so far, first seen Sep 5

Job description

View original posting ↗

At Somerset Bridge Group, we're transforming our data platform to create a modern, cloud-based data ecosystem that powers smarter decision-making across the business. As part of this journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation.

Joining our Enterprise Data Team, you'll play a key role in designing, building and optimising scalable data solutions that support Pricing, Underwriting, Claims and wider business operations. Working with large and complex datasets, you'll develop robust data pipelines and platforms that enable analytics, reporting, machine learning and AI-driven initiatives across the organisation.

You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance and security controls, optimising cloud-based data infrastructure, and supporting both real-time and batch data processing.

Working closely with Data Architects, Analysts, Pricing teams and Technology colleagues, you'll help shape the future of SBG's enterprise data platform, delivering scalable, secure and efficient solutions that support strategic business objectives and regulatory requirements.

This is an exciting opportunity to join a growing Enterprise Data Team and make a significant impact on the development of a modern Azure-based data platform, helping to drive data-led innovation across the business.

What you'll be responsible for:

  • Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing.
  • Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability and cost efficiency.
  • Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
  • Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor.
  • Ensure data quality, integrity and governance through effective controls, security standards and regulatory compliance.
  • Collaborate with stakeholders across Pricing, Underwriting, Data Science and Technology to deliver data-driven business solutions.
  • Implement data security and governance frameworks, including access controls, data lineage and sensitive data protection.
  • Drive continuous improvement by adopting new technologies and best practices across the Azure and Databricks ecosystem.

What you'll need:

  • Strong experience building data pipelines using Azure Data Factory, Databricks and Azure Data Lake.
  • Advanced SQL and Python (PySpark) skills for data transformation, automation and optimisation.
  • Hands-on experience with Delta Lake, Spark, Databricks Workflows and Structured Streaming.
  • Knowledge of data warehousing, lakehouse architectures and dimensional modelling.
  • Experience delivering scalable, high-quality data solutions to support analytics, reporting and machine learning.
  • Familiarity with real-time data processing, APIs and streaming technologies such as Kafka or Azure Event Hubs.
  • Experience with CI/CD, Azure DevOps, GitHub Actions and Infrastructure as Code.
  • Strong understanding of data governance, security and access controls, including Unity Catalog and Purview.
  • Experience monitoring, optimising and troubleshooting cloud-based data platforms.
  • Excellent problem-solving, communication and stakeholder management skills.
  • Collaborative approach with the ability to work effectively across technical and business teams.
  • Passion for innovation, continuous improvement and emerging data technologies.
Desirable
  • Experience with Scala.
  • Exposure to MLOps, feature stores and machine learning platforms.

Our Benefits

  • Hybrid working – 2 days in the office and 3 days working from home
  • 25 days annual leave, rising to 27 days over 2 years’ service and 30 days after 5 years’ service. Plus bank holidays!
  • Discretionary annual bonus
  • Pension scheme – 5% employee, 6% employer
  • Flexible working – we will always consider applications for those who require less than the advertised hours
  • Flexi-time
  • Healthcare Cash Plan – claim cashback on a variety of everyday healthcare costs
  • Electric vehicle – salary sacrifice scheme
  • 100’s of exclusive retailer discounts
  • Professional wellbeing, health & fitness app - Wrkit
  • Enhanced parental leave, including time off for IVF appointments
  • Religious bank holidays – if you don’t celebrate Christmas and Easter, you can use these annual leave days on other occasions throughout the year.
  • Life Assurance - 4 times your salary
  • 25% Car Insurance Discount
  • 20% Travel Insurance Discount
  • Cycle to Work Scheme   
  • Employee Referral Scheme
  • Community support day

Compensation

£53,000 - £67,000 / year

Employment type

Permanent - Full Time

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Compensation £53,000 - £67,000 / year Employment type
Location & working pattern

Bristol, United Kingdom

Our Benefits - Hybrid working – 2 days in the office and 3 days working from home - 25 days annual leave, rising to 27 days over 2 years’ service and 30 days after 5 years’ service. Plus bank holidays!
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.