Back to jobs

Senior Data Platform Engineer AWS, Spark

Nottingham, United Kingdom

Live, first seen by us 12 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
This is a hands-on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud-native tooling, and help drive automation and continuous improvement across the engineering lifecycle. This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering. Key responsibilities
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets

  • Ingest and transform data from sources such as Snowflake and internal product systems

  • Develop new data flows, integrations and automation as data assets are onboarded

  • Use Terraform, Git and CI/CD pipelines to deliver repeatable infrastructure

  • Write documentation for pipelines, data flows and support processes

From the employer’s posting
Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
Develop new data flows, integrations and automation as additional data assets are onboarded.
Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
Produce clear documentation covering pipelines, data flows, operational procedures and support processes.

What you’ll bring

All qualifications

Core experience

  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments

Preferred experience

  • Strong expertise in Terraform or CloudFormation.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Knowledge of RESTful APIs and microservice architectures.
Qualification wording
Strong experience building data pipelines, data lake solutions or data platform capabilities.
Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
Strong experience developing on Apache Spark or Hadoop.
Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments
Strong expertise in Terraform or CloudFormation.
Experience with OpenShift or Kubernetes.
Experience with automated testing tools such as pytest or Scalatest.
Knowledge of RESTful APIs and microservice architectures.
Apply at Experian

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 9, 202612 days ago
Recorded sightings
13
Last seen by us
Nov 21, 2026
Reposted
once since Oct 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.

How this job compares

Time since we first saw it

Day 12

Similar jobs usually come down between day 6 and day 56.

At Experian, jobs usually come down by about day 9.

From 14,771 similar postings that came down, and 268 of Experian’s. Coming down is not always a hire.

Experian is hiring

32 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring is steady
  • Takes jobs down quickly
  • 31% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Scala
  • AWS
  • Hadoop
  • Kubernetes
  • S3
  • Snowflake
  • Spark
  • Terraform
Where the posting names them
- Strong experience developing on Apache Spark or Hadoop. - Significant programming experience using Scala or Python. - Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments
Key responsibilities - Design, build, test and maintain AWS-based data pipelines for fraud-related data assets. - Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
- Strong experience building data pipelines, data lake solutions or data platform capabilities. - Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS. - Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
Desired skills - AWS Developer Certification or other relevant AWS certification. - Strong expertise in Terraform or CloudFormation.
- Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins. - Strong experience developing on Apache Spark or Hadoop. - Significant programming experience using Scala or Python.
- Strong expertise in Terraform or CloudFormation. - Experience with OpenShift or Kubernetes. - Experience with automated testing tools such as pytest or Scalatest.
- Design, build, test and maintain AWS-based data pipelines for fraud-related data assets. - Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems. - Develop new data flows, integrations and automation as additional data assets are onboarded.
- Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions. - Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions. - Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
- Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS. - Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins. - Strong experience developing on Apache Spark or Hadoop.
- AWS Developer Certification or other relevant AWS certification. - Strong expertise in Terraform or CloudFormation. - Experience with OpenShift or Kubernetes.

Your next step

Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.

Applying through SmartRecruiters

  • Uploading your resume fills in the application form for you, so check what it filled before you send.

Already applied? Track this application

Job description

View original posting ↗

Job Description

Experian Credit Services & Verifications are looking for a Senior Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability that will connect fraud-related data assets into Experian's Data Analytics Platform.

You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions.

This is a hands-on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud-native tooling, and help drive automation and continuous improvement across the engineering lifecycle.

This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering.

Key responsibilities

  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
  • Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
  • Develop new data flows, integrations and automation as additional data assets are onboarded.
  • Work with platform, security and data stakeholders to ensure solutions follow agreed security, governance and compliance patterns.
  • Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions.
  • Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
  • Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
  • Support junior engineers where appropriate and contribute to a collaborative, quality-focused engineering culture.
  • Use modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.

Qualifications

  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience using Scala or Python.
  • Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments

Desired skills

  • AWS Developer Certification or other relevant AWS certification.
  • Strong expertise in Terraform or CloudFormation.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Knowledge of RESTful APIs and microservice architectures.
  • Experience working with sensitive, governed or regulated data environments.
  • Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.

Additional Information

  • Great compensation package and discretionary bonus plan
  • Core benefits include pension, bupa healthcare, sharesave scheme and more
  • 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.

Internal Grade D/EB8

About Experian

People
About 6,165 in 2024.Benefit plan filings (Form 5500)
Company
Listed as EXPN.L.
Layoff notices
Notices this year and last cover 66 people. The latest was filed March 30, 2026.State WARN notices

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Nottingham, United Kingdom

This is a hands-on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud-native tooling, and help drive automation and continuous improvement across the engineering lifecycle. This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering. Key responsibilities
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.