Back to jobs

Principal Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting
  • Define and own data engineering architecture patterns across client engagements

  • Lead technical design of large-scale data migrations to modern cloud platforms

  • Architect real-time and near-real-time data pipelines for demanding clients

  • Review and sign off technical designs from Lead and Senior engineers

  • Mentor and grow Lead and Senior Data Engineers

From the employer’s posting
Defining and owning the data engineering architecture patterns CreateFuture uses across client engagements
Leading the technical design and execution of large-scale data migrations
Architecting real-time and near-real-time data pipelines for clients with demanding latency and correctness requirements
Reviewing and signing off technical designs produced by Lead and Senior engineers across active engagements
Mentoring and growing Lead and Senior Data Engineers
Apply at CreateFuture

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 2, 202650 days ago
Recorded sightings
53
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 50

Similar jobs usually come down between day 6 and day 56.

From 14,767 similar postings that came down. Coming down is not always a hire.

CreateFuture is hiring

7 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • dbt
  • Kafka
  • Redshift
  • S3
  • Spark
  • Terraform
  • Airflow
Where the posting names them
Engineering excellence - Mastery of Python, SQL, and Spark — and strong opinions on how they should be used in production data pipelines - Deep experience with dbt, Airflow, or equivalent orchestration — including how to build pipelines that are testable, observable, and operationally sound
Cloud data engineering mastery - You can design across the full data engineering stack — from ingestion and streaming through to warehousing, serving, and cost optimisation — on a major cloud platform (AWS strongly preferred) - You have deep experience with streaming architectures — Kinesis, Kafka/MSK, Flink, or Spark Streaming — and know when each is the right choice
- Strong understanding of data quality engineering — not just validation rules, but how to build systems that detect and surface integrity issues before they reach consumers - Comfortable with infrastructure-as-code (Terraform, AWS CDK) and treating data platform infrastructure as a first-class engineering concern Leadership
- Mastery of Python, SQL, and Spark — and strong opinions on how they should be used in production data pipelines - Deep experience with dbt, Airflow, or equivalent orchestration — including how to build pipelines that are testable, observable, and operationally sound - Strong understanding of data quality engineering — not just validation rules, but how to build systems that detect and surface integrity issues before they reach consumers
- You can design across the full data engineering stack — from ingestion and streaming through to warehousing, serving, and cost optimisation — on a major cloud platform (AWS strongly preferred) - You have deep experience with streaming architectures — Kinesis, Kafka/MSK, Flink, or Spark Streaming — and know when each is the right choice - You can model the cost implications of architecture decisions and advise clients on trade-offs between throughput, latency, durability, and spend
- Overseeing the implementation of regulatory and compliance reporting pipelines where relevant to a client's sector - Working with cloud data services (e.g. S3, Glue, Lambda, Athena, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA, or their equivalents on other platforms) — selecting the right tool for each problem rather than defaulting to a stack Practice and people

Your next step

Complete your application on job-boards.eu.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

Working at CreateFuture

CreateFuture is an AI-native consulting partner where people do work that matters and are supported to do it well. We work alongside organisations such as PayPal, adidas, NatWest, FanDuel and Money Saving Expert, building digital products and services that make a difference  while always putting people first.

We’re a team of creators. We write code, shape delivery, build go-to-market strategies, develop AI solutions and create the practices that support our people. We work side by side with our clients, challenging what’s not working and helping them to build the future. Our commitment to craft, quality, and culture has helped us scale to over 600 people in just a few years.

CreateFuture is a Great Place to Work-Certified™ company and has won Best Workplaces UK multiple years in a row.

Join us on our journey. Let’s create tomorrow, together, today.

About the role and team:

We're looking for a Principal Data Engineer to join our Data Practice and lead the technical direction of our engineering capability. You'll work across a portfolio of clients spanning multiple industries, helping some of the most ambitious organisations in the UK solve their hardest data problems.A Principal at CreateFuture operates above the delivery line as well as within it. You'll define how we solve the hardest data engineering problems across our client base, influence the shape of engagements from pre-sales through to delivery, grow the data talent around you, and be a recognisable voice for CreateFuture in the data engineering community.

What you'll be doing:

Technical leadership

  • Defining and owning the data engineering architecture patterns CreateFuture uses across client engagements — migration frameworks, streaming architectures, data integrity standards, and Lakehouse design
  • Acting as the most senior technical authority on client engagements — making critical architecture decisions, resolving design disputes, and setting the bar for quality
  • Reviewing and signing off technical designs produced by Lead and Senior engineers across active engagements
  • Identifying and driving the adoption of new tooling, patterns, and cloud services that improve delivery outcomes across the data practice

Delivery

  • Leading the technical design and execution of large-scale data migrations — moving high-volume transactional and event data from on-premises or legacy cloud estates to modern cloud platforms, without loss of fidelity or operational continuity
  • Architecting real-time and near-real-time data pipelines for clients with demanding latency and correctness requirements
  • Designing and enforcing data integrity frameworks across critical data domains — including reconciliation between source and target systems, anomaly detection, and audit trail requirements
  • Overseeing the implementation of regulatory and compliance reporting pipelines where relevant to a client's sector
  • Working with cloud data services (e.g. S3, Glue, Lambda, Athena, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA, or their equivalents on other platforms) — selecting the right tool for each problem rather than defaulting to a stack

Practice and people

  • Mentoring and growing Lead and Senior Data Engineers — through code review, pairing, architecture sessions, and career conversations
  • Building CreateFuture's data engineering playbook: reusable patterns, accelerators, and reference architectures that reduce time-to-value on new engagements
  • Contributing to hiring — defining what great looks like for data engineering roles and playing an active part in assessment
  • Representing CreateFuture externally — at industry events, in technical blog posts, and in client-facing settings — as a credible voice on data engineering
  • Working closely with the Head of Data to enable the growth of the right skills and capabilities to meet client needs.

Commercial

  • Shaping and leading technical responses to opportunities — scoping complex engagements, writing architecture proposals, and presenting to senior client stakeholders
  • Identifying expansion opportunities within existing client relationships — spotting data engineering problems we can help solve and framing them as propositions
  • Partnering with cloud providers on joint go-to-market activity where relevant, leveraging CreateFuture's partner status

    What we're looking for:

    Consulting background

    1. You've spent a significant part of your career in a consultancy, professional services, or client-facing delivery environment — you know how to build trust quickly, work across ambiguous or fast-changing requirements, and deliver under commercial pressure
    2. You're comfortable moving between clients and industries, ramping up on new domains quickly rather than relying on years of embedded context
    3. You've shaped and sold technical work — writing proposals, scoping engagements, and presenting architecture decisions to client stakeholders
    4. You understand the difference between "good engineering" and "good engineering for this client, this budget, this timeline" — and can navigate that trade-off transparently


    Cloud data engineering mastery

    • You can design across the full data engineering stack — from ingestion and streaming through to warehousing, serving, and cost optimisation — on a major cloud platform (AWS strongly preferred)
    • You have deep experience with streaming architectures — Kinesis, Kafka/MSK, Flink, or Spark Streaming — and know when each is the right choice
    • You can model the cost implications of architecture decisions and advise clients on trade-offs between throughput, latency, durability, and spend
    • Cloud certification at professional or specialty level is strongly preferred

    Engineering excellence

    • Mastery of Python, SQL, and Spark — and strong opinions on how they should be used in production data pipelines
    • Deep experience with dbt, Airflow, or equivalent orchestration — including how to build pipelines that are testable, observable, and operationally sound
    • Strong understanding of data quality engineering — not just validation rules, but how to build systems that detect and surface integrity issues before they reach consumers
    • Comfortable with infrastructure-as-code (Terraform, AWS CDK) and treating data platform infrastructure as a first-class engineering concern

    Leadership

    • You've operated at Principal or equivalent level — making architectural decisions that affect multiple teams, and being accountable for their outcomes
    • You're comfortable in C-suite and VP-level client conversations, translating technical complexity into business risk and opportunity
    • You can hold a room on a difficult technical topic and reach a decision — not just present options
    • You've grown engineering talent around you and take it seriously as a leadership responsibility

What we’ll offer you:

We trust people to do their best work. That means flexibility over rigid rules, impact over activity, and real investment in your growth both professionally and personally. You’ll be part of a supportive, and friendly culture, surrounded by smart, curious people who care deeply about what they do.

We offer flexible working, including hybrid and remote options. Our office hubs are located in Edinburgh, Leeds, Manchester, London and Bulgaria, with occasional travel to client sites or CreateFuture offices when needed.

We trust you to manage your time balancing collaboration with client time and focused work. What matters is the impact you have, not how busy you look.

Our hiring process

We try to keep our hiring process clear, fair and respectful of your time. We aim to get back to everyone who applies and we will be upfront about where you are in the process.

It usually looks like this:

  • Call with our Talent Acquisition Team 
  • Role specific capability interview 

Depending on the role, we might also ask you to do a short presentation, a practical or technical task or have a values focused conversation. We will explain what is involved before anything happens.

Inclusion at CreateFuture 

We believe diverse teams build better workplaces and better products. We want CreateFuture to be a place where people feel able to be themselves and do their best work.

If you need any adjustments or support during the application process, just. We will do what we can to help.

We look forward to your application!

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

United Kingdom

We trust people to do their best work. That means flexibility over rigid rules, impact over activity, and real investment in your growth both professionally and personally. You’ll be part of a supportive, and friendly culture, surrounded by smart, curious people who care deeply about what they do. We offer flexible working, including hybrid and remote options. Our office hubs are located in Edinburgh, Leeds, Manchester, London and Bulgaria, with occasional travel to client sites or CreateFuture offices when needed. We trust you to manage your time balancing collaboration with client time and focused work. What matters is the impact you have, not how busy you look.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.