Back to jobs

Senior Data Lakehouse Architect (Databricks), Vice President

Quincy, Massachusetts, United States of America

Open 6 months, first seen by us 190 days ago
Pay
$120,000–202,500/year — pay source
Salary Range: $120,000 - $202,500 Annual The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Define the end-to-end Legal Data Lakehouse architecture on Databricks and AWS

  • Lead ETL/ELT pipeline development using Databricks, Spark, and Python/SQL

  • Implement data governance with Unity Catalog, fine-grained access, and lineage

  • Design search and retrieval (RAG) architectures for enterprise legal knowledge bases

  • Establish CI/CD pipelines and infrastructure-as-code using Terraform and Git

From the employer’s posting
Define and implement the end-to-end Legal Data Lakehouse architecture
Lead development of ETL/ELT pipelines using Databricks, Spark, and Python/SQL
Implement data governance frameworks using Databricks Unity Catalog and AWS-native controls (IAM, KMS)
Design search and retrieval architectures (RAG) for enterprise legal knowledge bases
Establish CI/CD pipelines and infrastructure-as-code (Terraform, Git-based workflows)

What you’ll bring

All qualifications

Core experience

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline
  • Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM
  • Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks
  • Strong understanding of data governance and security, including access controls, metadata management, and encryption (KMS, CMK/BYOK)
  • Experience building end-to-end data pipelines (batch and streaming) and supporting AI/ML workloads within a lakehouse architecture
  • Experience in Legal, Compliance, Financial Services, or other regulated industries
Qualification wording
Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline
Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM
Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks
Strong understanding of data governance and security, including access controls, metadata management, and encryption (KMS, CMK/BYOK)
Experience building end-to-end data pipelines (batch and streaming) and supporting AI/ML workloads within a lakehouse architecture
Experience in Legal, Compliance, Financial Services, or other regulated industries
Education & alternatives
Education - Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline - Relevant certifications strongly preferred:- Databricks Certified Data Engineer / Architect

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability.

In the employer’s words · Read in context

Apply at State Street

Posting record

Report an error

Open 6 monthsWe first saw this posting 190 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
May 15, 2026190 days ago
Recorded sightings
235
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$120K–$203K against $155K–$227K, the middle half of what similar US postings state.

From 3,272 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 190

Up longer than most. Similar jobs usually come down between day 8 and day 57.

Well past State Street’s usual: its jobs come down by about day 31.

From 9,984 similar postings that came down, and 380 of State Street’s. Coming down is not always a hire.

State Street is hiring

125 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Leadership hiring has slowed
  • Takes jobs down at a usual pace
  • 2% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Scala
  • SQL
  • AWS
  • Azure
  • Databricks
  • Delta Lake
  • MLflow
  • Redshift
  • S3
  • Spark
  • Terraform
  • PySpark
Where the posting names them
2. Data Engineering & Integration - Lead development of ETL/ELT pipelines using Databricks, Spark, and Python/SQL - Integrate with enterprise platforms, including:- Contract lifecycle management systems
- Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks - Advanced proficiency in Apache Spark (PySpark/Scala), SQL, and Python - Strong understanding of data governance and security, including access controls, metadata management, and encryption (KMS, CMK/BYOK)
Who We Are Looking For We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of a Legal Data Lakehouse platform on AWS and Databricks. This role will drive the architecture, engineering, and governance of scalable, secure, and compliant data capabilities supporting legal operations, contract intelligence, eDiscovery, and AI/ML use cases. The ideal candidate brings deep expertise in Databricks, AWS data platforms, and enterprise data architecture, with experience delivering solutions in regulated environments aligned to security, compliance, and audit requirements.
We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of a Legal Data Lakehouse platform on AWS and Databricks. This role will drive the architecture, engineering, and governance of scalable, secure, and compliant data capabilities supporting legal operations, contract intelligence, eDiscovery, and AI/ML use cases. The ideal candidate brings deep expertise in Databricks, AWS data platforms, and enterprise data architecture, with experience delivering solutions in regulated environments aligned to security, compliance, and audit requirements. Why This Role Is Important to Us
1. Architecture & Platform Design - Define and implement the end-to-end Legal Data Lakehouse architecture using Databricks (Delta Lake, Unity Catalog, Workflows) on AWS - Design multi-layered data architecture (Bronze, Silver, Gold) to support:- Contract metadata and document ingestion
3. Governance, Security & Compliance - Implement data governance frameworks using Databricks Unity Catalog and AWS-native controls (IAM, KMS) - Establish:- Fine-grained access controls (row/column-level security)
- 5+ years of hands-on experience with Databricks and Apache Spark - Strong experience with AWS-based data platforms - Expertise in data governance, security, and compliance in regulated environments
- Relevant certifications strongly preferred:- Databricks Certified Data Engineer / Architect - AWS Certified Solutions Architect (Associate or Professional) Preferred Qualifications (Core – Databricks, AWS, Data Lakehouse)
- AWS Certified Solutions Architect (Associate or Professional) Preferred Qualifications (Core – Databricks, AWS, Data Lakehouse) - Strong hands-on experience with the Databricks Lakehouse platform, including Delta Lake, Unity Catalog, Workflows, and MLflow
- Strong hands-on experience with the Databricks Lakehouse platform, including Delta Lake, Unity Catalog, Workflows, and MLflow - Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM - Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks
- Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM - Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks - Advanced proficiency in Apache Spark (PySpark/Scala), SQL, and Python
- Internal security and audit requirements - Partner with IAM teams to integrate with enterprise identity providers (e.g., Entra ID / Azure AD) 4. AI/ML & Advanced Analytics Enablement
Senior Data Lakehouse Architect (Databricks), Vice President Corporate Functions Technology
- 10+ years of experience in data architecture, engineering, or analytics platforms - 5+ years of hands-on experience with Databricks and Apache Spark - Strong experience with AWS-based data platforms
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline - Relevant certifications strongly preferred:- Databricks Certified Data Engineer / Architect - AWS Certified Solutions Architect (Associate or Professional)
Preferred Qualifications (Core – Databricks, AWS, Data Lakehouse) - Strong hands-on experience with the Databricks Lakehouse platform, including Delta Lake, Unity Catalog, Workflows, and MLflow - Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM
- Document repositories and enterprise content systems - Design patterns for extracting structured data from unstructured legal documents and persisting into Delta Lake - Enable downstream integration with enterprise data platforms, analytics tools, and AI/ML pipelines
5. DevOps & Platform Operations - Establish CI/CD pipelines and infrastructure-as-code (Terraform, Git-based workflows) - Define standards for:- Code quality and versioning

Your next step

Complete your application on statestreet.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Phenom

  • Phenom runs the employer’s careers site, but the application itself usually runs on another system, often Workday or Taleo. The advice for that system applies once you click Apply.

Already applied? Track this application

Job description

View original posting ↗

Senior Data Lakehouse Architect (Databricks), Vice President

Corporate Functions Technology

Who We Are Looking For

We are seeking a Senior Data Lakehouse Architect to design and lead the build-out of a Legal Data Lakehouse platform on AWS and Databricks. This role will drive the architecture, engineering, and governance of scalable, secure, and compliant data capabilities supporting legal operations, contract intelligence, eDiscovery, and AI/ML use cases.

The ideal candidate brings deep expertise in Databricks, AWS data platforms, and enterprise data architecture, with experience delivering solutions in regulated environments aligned to security, compliance, and audit requirements.

Why This Role Is Important to Us

State Street’s Legal function operates across a broad set of contracts, matters, regulatory obligations, documents, and workflows that are distributed across multiple systems and formats. Building a modern Legal Data Lakehouse is critical to creating a trusted, governed foundation that brings these data sources together—making legal information easier to access, analyze, and use at scale.

This role is critical to establishing a secure and scalable data foundation that enables legal analytics and AI use cases while strengthening governance, auditability, and global consistency across Legal.

What You Will Be Responsible For

1. Architecture & Platform Design

  • Define and implement the end-to-end Legal Data Lakehouse architecture using Databricks (Delta Lake, Unity Catalog, Workflows) on AWS
  • Design multi-layered data architecture (Bronze, Silver, Gold) to support:
    • Contract metadata and document ingestion
    • Legal matter management data
    • eDiscovery datasets
    • External regulatory and compliance feeds
  • Establish scalable ingestion frameworks (batch and streaming) for structured and unstructured legal data (PDFs, contracts, emails)

2. Data Engineering & Integration

  • Lead development of ETL/ELT pipelines using Databricks, Spark, and Python/SQL
  • Integrate with enterprise platforms, including:
    • Contract lifecycle management systems
    • AI platforms and LLM pipelines
    • Document repositories and enterprise content systems
  • Design patterns for extracting structured data from unstructured legal documents and persisting into Delta Lake
  • Enable downstream integration with enterprise data platforms, analytics tools, and AI/ML pipelines

3. Governance, Security & Compliance

  • Implement data governance frameworks using Databricks Unity Catalog and AWS-native controls (IAM, KMS)
  • Establish:
    • Fine-grained access controls (row/column-level security)
    • Data lineage and auditability
  • Ensure compliance with:
    • Data privacy regulations (e.g., GDPR)
    • Internal security and audit requirements
  • Partner with IAM teams to integrate with enterprise identity providers (e.g., Entra ID / Azure AD)

4. AI/ML & Advanced Analytics Enablement

  • Architect data models supporting:
    • Contract analytics, clause extraction, and obligation tracking
    • Legal AI use cases (contract review, litigation insights, compliance monitoring, legal spend analytics)
  • Design search and retrieval architectures (RAG) for enterprise legal knowledge bases
  • Enable entity extraction and knowledge graph frameworks
  • Integrate with LLM/GenAI platforms to support capabilities such as document summarization, Q&A, and workflow automation

5. DevOps & Platform Operations

  • Establish CI/CD pipelines and infrastructure-as-code (Terraform, Git-based workflows)
  • Define standards for:
    • Code quality and versioning
    • Environment promotion (Dev / QA / Prod)
  • Implement observability and alerting for platform health and reliability

6. Leadership & Stakeholder Engagement

  • Partner with Legal and Technology leadership to define platform roadmap and priorities
  • Provide architectural governance and design oversight
  • Mentor data engineers and platform teams
  • Translate business and legal requirements into scalable, enterprise-grade solutions
  • Operate within a federated data and platform model, collaborating across engineering, security, and domain teams

What We Value

The skills that will help you succeed in this role include:

  • 10+ years of experience in data architecture, engineering, or analytics platforms
  • 5+ years of hands-on experience with Databricks and Apache Spark
  • Strong experience with AWS-based data platforms
  • Expertise in data governance, security, and compliance in regulated environments
  • Experience working with unstructured data and NLP/document processing pipelines

Education & Preferred Qualifications

Education

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related technical discipline
  • Relevant certifications strongly preferred:
    • Databricks Certified Data Engineer / Architect
    • AWS Certified Solutions Architect (Associate or Professional)

Preferred Qualifications (Core – Databricks, AWS, Data Lakehouse)

  • Strong hands-on experience with the Databricks Lakehouse platform, including Delta Lake, Unity Catalog, Workflows, and MLflow
  • Deep expertise in AWS data platform services, including S3, Glue, EMR, Lambda, Redshift, and IAM
  • Proven experience architecting and delivering enterprise-scale data lakehouse solutions on AWS using Databricks
  • Advanced proficiency in Apache Spark (PySpark/Scala), SQL, and Python
  • Strong understanding of data governance and security, including access controls, metadata management, and encryption (KMS, CMK/BYOK)
  • Experience building end-to-end data pipelines (batch and streaming) and supporting AI/ML workloads within a lakehouse architecture

Nice to Have (Domain & Industry Experience)

  • Experience in Legal, Compliance, Financial Services, or other regulated industries
  • Understanding of legal data constructs, including contracts, clauses, obligations, and matters
  • Experience supporting legal AI use cases (contract analytics, document summarization, compliance monitoring)
  • Experience handling sensitive data in highly regulated, audit-driven environments

Salary Range:

$120,000 - $202,500 Annual

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

For a full overview, visit https://hrportal.ehr.com/statestreet/Home.


About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.


We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.


As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.


Discover more information on jobs at StateStreet.com/careers


Read our CEO Statement

Job Application Disclosure:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

About State Street

People
About 52,000 in 2025, down 2% from the year before.Annual report (SEC Form 10-K)
Company
Listed as STT.

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 751, the most 1,165, and the latest week had 775.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Salary Range: $120,000 - $202,500 Annual The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ.
Location & working pattern

Quincy, Massachusetts, United States of America

The range quoted above applies to the role in the primary location specified. If the candidate would ultimately work outside of the primary location above, the applicable range could differ. Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans. For a full overview, visit https://hrportal.ehr.com/statestreet/Home.
Work authorization
We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.