Back to jobs

Senior Databricks / Snowflake Data Architect – BestX

London, London, United Kingdom

Open 6 months, first seen by us 191 days ago
Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Design the architecture for BestX's multi-asset TCA and analytics platform

  • Build Lakehouse solutions using Databricks, Snowflake and cloud-native services

  • Lead technology evaluations and proofs of concept across data platforms

  • Design data models, ingestion and pipelines for real-time and batch workloads

  • Set data governance, lineage, security and observability best practices

From the employer’s posting
Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform
Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services
Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies
Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads
Establish best practices for data governance, lineage, security, metadata management, and platform observability

What you’ll bring

All qualifications

Preferred experience

  • Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives
  • Knowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructure
  • Experience with AI/ML platforms, feature stores, and MLOps frameworks
  • Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures
Qualification wording
Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives
Knowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructure
Experience with AI/ML platforms, feature stores, and MLOps frameworks
Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability.

In the employer’s words · Read in context

Apply at State Street

Posting record

Report an error

Open 6 monthsWe first saw this posting 191 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
May 14, 2026191 days ago
Recorded sightings
263
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 191

Up longer than most. Similar jobs usually come down between day 8 and day 57.

Well past State Street’s usual: its jobs come down by about day 31.

From 9,984 similar postings that came down, and 380 of State Street’s. Coming down is not always a hire.

State Street is hiring

125 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Leadership hiring has slowed
  • Takes jobs down at a usual pace
  • 2% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • BigQuery
  • ClickHouse
  • Databricks
  • Delta Lake
  • DuckDB
  • Iceberg
  • Kafka
  • Power BI
  • Redshift
  • S3
  • Sigma
  • Snowflake
  • Spark
  • Tableau
Where the posting names them
- Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities - Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks - Proven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patterns
- Strong understanding of data architecture principles including dimensional modelling, Data Vault, Lakehouse methodologies, and distributed computing - Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services - Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent
- Experience with AI/ML platforms, feature stores, and MLOps frameworks - Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures - Experience with data catalogue and governance platforms
We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities. The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies. You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementations
- Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies - Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services - Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads
- Experience in designing and implementing enterprise-scale data platforms. - Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture - Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities
- Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services - Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent - Deep understanding of data governance, security, lineage, and regulatory controls in financial services environments
- Experience with data catalogue and governance platforms - Exposure to modern visualisation and BI tools such as Power BI, Tableau, Sigma, or ThoughtSpot - Experience leading cloud migration or platform modernisation initiatives
- Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture - Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities - Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks

Your next step

Complete your application on statestreet.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Phenom

  • Phenom runs the employer’s careers site, but the application itself usually runs on another system, often Workday or Taleo. The advice for that system applies once you click Apply.

Already applied? Track this application

Job description

View original posting ↗

We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities.

The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies. You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementations

Key Responsibilities

  • Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform

  • Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies

  • Architect and implement scalable data Lakehouse solutions using Databricks, Snowflake, and cloud-native services

  • Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads

  • Establish best practices for data governance, lineage, security, metadata management, and platform observability

  • Build and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasets

  • Work closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutions

  • Define architectural standards and technology roadmaps for data warehousing, Lakehouse, streaming, and AI/ML workloads

  • Drive adoption of modern Agile, DevOps, CI/CD, Infrastructure-as-Code, and DataOps practices

  • Develop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIR

  • Mentor engineering teams and provide technical leadership across strategic platform initiatives

  • Take ownership of architecture decisions from concept through production delivery

Core Skills and Experience

  • Experience in designing and implementing enterprise-scale data platforms.

  • Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture

  • Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities

  • Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks

  • Proven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patterns

  • Experience designing large-scale analytical platforms supporting high-volume and high-velocity datasets

  • Strong understanding of data architecture principles including dimensional modelling, Data Vault, Lakehouse methodologies, and distributed computing

  • Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services

  • Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent

  • Deep understanding of data governance, security, lineage, and regulatory controls in financial services environments

  • Strong software engineering and DevOps mindset, including CI/CD and Infrastructure-as-Code

  • Excellent stakeholder management and communication skills, capable of influencing architecture decisions across multiple teams

Preferred Skills

  • Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives

  • Knowledge of Transaction Cost Analysis (TCA), execution analytics, and market microstructure

  • Experience with AI/ML platforms, feature stores, and MLOps frameworks

  • Experience evaluating alternative analytical databases such as DuckDB, ClickHouse, Redshift, BigQuery, KDB+, or Apache Iceberg-based architectures

  • Experience with data catalogue and governance platforms

  • Exposure to modern visualisation and BI tools such as Power BI, Tableau, Sigma, or ThoughtSpot

  • Experience leading cloud migration or platform modernisation initiatives

  • Experience operating in highly regulated financial services environments

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at StateStreet.com/careers

Read our CEO Statement

About State Street

People
About 52,000 in 2025, down 2% from the year before.Annual report (SEC Form 10-K)
Company
Listed as STT.

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 751, the most 1,165, and the latest week had 775.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

London, London, United Kingdom

Working pattern and location restrictions need checking in the full posting.

Work authorization
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.