Back to jobs

Lead Data Engineer

Toronto, ON, CA, M5H 1A1

Live, first seen by us 16 days ago
Pay
Pay not listedSimilar roles state $127K–$190K
Work setting
Not stated
Employment
Not stated

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 2, 202616 days ago
Recorded sightings
16
Last seen by us
Nov 18, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$190K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,396 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 16

Similar jobs usually come down between day 6 and day 56.

From 14,166 similar postings that came down. Coming down is not always a hire.

The Bank of Nova Scotia P is hiring

36 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • Scala
  • SQL
  • BigQuery
  • Cloudera
  • dbt
  • GCP
  • Hadoop
  • HDFS
  • Hive
  • Kafka
  • NoSQL
  • PostgreSQL
  • Sqoop
  • Terraform
Where the posting names them
- Guide a team of data engineers and work hands on in developing framework and custom code using best practices that will meet the demanding performance requirements - Take a lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc. - Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery
- Take a lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc. - Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery - Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management
- Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform - Knowledge of Java microservices and Spring Boot - Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
- Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure. - Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring - Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams
- Expertise knowledge of Hadoop HDFS, Hive, Pig, Flume and Sqoop. - Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc. - Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
- Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc. - Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL) - Working experience in HQL
- Build distributed, reliable and scalable data pipelines to ingest and process data from multiple data sources - Designing, building, operationalizing the data platform using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github - Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team in meeting the operational data needs of the various stake holders within Wealth Management. The Lead Data Engineer will play a key role in designing and implementing data solutions using Big Data, Hadoop (Cloudera) and Google cloud working closely with the enterprise data team and data architects, solution architects, business systems analyst and data engineers Is this role right for you? In this role you will:
- Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management - Provide end-to-end technical guidance and expertise on how to effectively use Google Cloud to build solutions; creatively applying cloud infrastructure and platform services to help solve business problems; and communicating these approaches to different business users - Provide guidance on Implementing application logging, notification, jobs monitoring and performance monitoring
Is this role right for you? In this role you will: - Leading development efforts in ingesting and transforming data from various sources. Working in the Big Data/ Hadoop environment, should be hands on in writing code, building scripts, writing specifications and responsible for end to end delivery of data in the Enterprise Data Lake environment - Build distributed, reliable and scalable data pipelines to ingest and process data from multiple data sources
- 10+ years of experience in data engineering, performance optimization for large OLTP applications - Expertise knowledge of Hadoop HDFS, Hive, Pig, Flume and Sqoop. - Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
- Working experience in HQL - Good knowledge of the concepts of Hadoop. - Experience working with relational/NoSQL databases
- Experience working with relational/NoSQL databases - Experience with data streaming and technologies such as Kafka, Spark-streaming etc. - Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
- Good knowledge of the concepts of Hadoop. - Experience working with relational/NoSQL databases - Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
- Experience with data streaming and technologies such as Kafka, Spark-streaming etc. - Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform - Knowledge of Java microservices and Spring Boot

Your next step

Complete your application on jobs.scotiabank.com. The employer’s form will show what is required.

Applying through SAP SuccessFactors

  • Images (.jpg) aren’t accepted as a resume.

Already applied? Track this application

Job description

View original posting ↗

 

 

 

Requisition ID: 276507 

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

 

The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team in meeting the operational data needs of the various stake holders within Wealth Management. The Lead Data Engineer will play a key role in designing and implementing data solutions using Big Data, Hadoop (Cloudera) and Google cloud working closely with the enterprise data team and data architects, solution architects, business systems analyst and data engineers

 

Is this role right for you? In this role you will:

 

  • Leading development efforts in ingesting and transforming data from various sources. Working in the Big Data/ Hadoop environment, should be hands on in writing code, building scripts, writing specifications and responsible for end to end delivery of data in the Enterprise Data Lake environment
  • Build distributed, reliable and scalable data pipelines to ingest and process data from multiple data sources
  • Designing, building, operationalizing the data platform using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
  • Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
  • Guide a team of data engineers and work hands on in developing framework and custom code using best practices that will meet the demanding performance requirements
  • Take a lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.
  • Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery
  • Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management
  • Provide end-to-end technical guidance and expertise on how to effectively use Google Cloud to build solutions; creatively applying cloud infrastructure and platform services to help solve business problems; and communicating these approaches to different business users
  • Provide guidance on Implementing application logging, notification, jobs monitoring and performance monitoring

 

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:

 

  • 10+ years of experience in data engineering, performance optimization for large OLTP applications
  • Expertise knowledge of Hadoop HDFS, Hive, Pig, Flume and Sqoop.
  • Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
  • Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
  • Working experience in HQL
  • Good knowledge of the concepts of Hadoop.
  • Experience working with relational/NoSQL databases
  • Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
  • Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
  • Knowledge of Java microservices and Spring Boot
  • Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
  • Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
  • Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams

Nice-To-Have Skills:

  • Understanding of Wealth business line and the various data domains required for building an end to end solution

 

What's in it for you?

 

  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.  
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance. 
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
  • Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
  • Community Engagement - We offer opportunities for community engagement & belonging with our various programs such as hackathons, contests, cooking with friends, Humans of Digital and much more!

 

Location(s):  Canada : Ontario : Toronto 

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.  

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our  Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 860, the most 1,353, and the latest week had 1,020.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Toronto, ON, CA, M5H 1A1

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.