Back to jobs

Senior Databricks Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Contract — employment source
Employment type in the employer’s posting: Contract
From the employer’s posting

What you’ll work on

Full posting
  • Design, build and maintain enterprise data pipelines using Databricks

  • Build ingestion and transformation with Lakeflow, Lakeflow Connect, Jobs and Auto Loader

  • Develop batch and streaming solutions with Apache Spark and PySpark

  • Modernize legacy ETL/ELT pipelines and data warehouse workloads

  • Implement data quality, validation, reconciliation, monitoring and Unity Catalog controls

From the employer’s posting
Design, build and maintain enterprise data pipelines using Databricks.
Build ingestion and transformation processes using Lakeflow, Lakeflow Connect, Jobs and Auto Loader.
Develop batch and streaming solutions with Apache Spark and PySpark.
Modernize legacy ETL/ELT pipelines and data warehouse workloads.
Implement data quality, validation, reconciliation, monitoring and Unity Catalog controls.

What you’ll bring

All qualifications

Core experience

  • Strong Python, SQL, Apache Spark and/or PySpark experience.
  • Experience designing enterprise pipelines and cloud-based data platforms, preferably Azure.
  • Experience with data quality, troubleshooting and performance optimization.
  • Experience with Git and modern software development practices.
Qualification wording
Strong Python, SQL, Apache Spark and/or PySpark experience.
Experience designing enterprise pipelines and cloud-based data platforms, preferably Azure.
Experience with data quality, troubleshooting and performance optimization.
Experience with Git and modern software development practices.
Apply at 49 Solutions

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Nov 11, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,771 similar postings that came down. Coming down is not always a hire.

49 Solutions is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SAS
  • SQL
  • Azure
  • Databricks
  • DataStage
  • Db2
  • Delta Lake
  • Oracle
  • Spark
  • SQL Server
  • Teradata
  • Terraform
  • PySpark
  • Netezza
Where the posting names them
Please note that these opportunities are currently prospective and are not associated with a guaranteed placement or awarded contract. Candidates who join our network will be considered for relevant opportunities as they become available. 49 Solutions is seeking Senior Databricks Data Engineers to design, develop and operationalize secure, scalable data pipelines and data products for Government of Canada environments using Databricks, Lakeflow, Delta Lake, Spark, Python and SQL. Responsibilities
• Demonstrated hands-on Databricks experience. • Strong Python, SQL, Apache Spark and/or PySpark experience. • Experience designing enterprise pipelines and cloud-based data platforms, preferably Azure.
• Apache Spark / PySpark • Python • SQL
• On-premises source integration • Migration from SAS, Synapse, DataStage, DB2, Oracle, SQL Server, Teradata or Netezza • Government of Canada delivery experience
• Python • SQL • ETL/ELT
• Strong Python, SQL, Apache Spark and/or PySpark experience. • Experience designing enterprise pipelines and cloud-based data platforms, preferably Azure. • Experience with data quality, troubleshooting and performance optimization.
• Medallion architecture • Azure data services • Git and CI/CD
• Terraform or Databricks Asset Bundles • Azure DevOps or GitHub • Microsoft Purview
• Databricks Unity Catalog or data governance training • Relevant Microsoft Azure data certifications • Additional advanced Databricks certifications
49 Solutions is proactively building a team of experienced, security-cleared professionals in preparation for anticipated Databricks initiatives within the Government of Canada. We are connecting with qualified candidates in advance so that we have a strong team ready to respond as relevant opportunities arise. Please note that these opportunities are currently prospective and are not associated with a guaranteed placement or awarded contract. Candidates who join our network will be considered for relevant opportunities as they become available.
Responsibilities • Design, build and maintain enterprise data pipelines using Databricks. • Build ingestion and transformation processes using Lakeflow, Lakeflow Connect, Jobs and Auto Loader.
• Develop and optimize Delta Lake tables and enterprise data products. • Connect Databricks with cloud, enterprise and on-premises sources. • Modernize legacy ETL/ELT pipelines and data warehouse workloads.
• Significant experience in data engineering, ETL/ELT or data integration. • Demonstrated hands-on Databricks experience. • Strong Python, SQL, Apache Spark and/or PySpark experience.
Technical Skills • Databricks • Lakeflow
• Lakeflow Connect and Auto Loader • Terraform or Databricks Asset Bundles • Azure DevOps or GitHub
Target Certification • Databricks Certified Data Engineer Professional. Candidates who do not currently hold the target certification may still be considered based on their experience. Candidates are not expected to obtain the certification immediately while 49 Solutions is building its prospective team. If a specific certification becomes required for an opportunity, candidates must be willing to obtain it at their own expense before being submitted for that opportunity.
Additional Asset Certifications • Databricks EDW/ETL migration training • Databricks Unity Catalog or data governance training
• Databricks EDW/ETL migration training • Databricks Unity Catalog or data governance training • Relevant Microsoft Azure data certifications
• Relevant Microsoft Azure data certifications • Additional advanced Databricks certifications Security Requirement
• Implement raw, cleaned and curated layers using Lakehouse and medallion patterns. • Develop and optimize Delta Lake tables and enterprise data products. • Connect Databricks with cloud, enterprise and on-premises sources.
• Lakeflow • Delta Lake • Unity Catalog
• Build ingestion and transformation processes using Lakeflow, Lakeflow Connect, Jobs and Auto Loader. • Develop batch and streaming solutions with Apache Spark and PySpark. • Implement raw, cleaned and curated layers using Lakehouse and medallion patterns.
• Unity Catalog • Apache Spark / PySpark • Python

Your next step

Complete your application on apply.workable.com. The employer’s form will show what is required.

Applying through Workable

  • No account needed. You can import your resume to fill in the form, or skip that and fill it in yourself.

Already applied? Track this application

Job description

View original posting ↗

49 Solutions is proactively building a team of experienced, security-cleared professionals in preparation for anticipated Databricks initiatives within the Government of Canada. We are connecting with qualified candidates in advance so that we have a strong team ready to respond as relevant opportunities arise. 

Please note that these opportunities are currently prospective and are not associated with a guaranteed placement or awarded contract. Candidates who join our network will be considered for relevant opportunities as they become available. 

49 Solutions is seeking Senior Databricks Data Engineers to design, develop and operationalize secure, scalable data pipelines and data products for Government of Canada environments using Databricks, Lakeflow, Delta Lake, Spark, Python and SQL. 

 

Responsibilities 

•       Design, build and maintain enterprise data pipelines using Databricks. 

•       Build ingestion and transformation processes using Lakeflow, Lakeflow Connect, Jobs and Auto Loader. 

•       Develop batch and streaming solutions with Apache Spark and PySpark. 

•       Implement raw, cleaned and curated layers using Lakehouse and medallion patterns. 

•       Develop and optimize Delta Lake tables and enterprise data products. 

•       Connect Databricks with cloud, enterprise and on-premises sources. 

•       Modernize legacy ETL/ELT pipelines and data warehouse workloads. 

•       Implement data quality, validation, reconciliation, monitoring and Unity Catalog controls. 

•       Develop reusable engineering patterns and participate in CI/CD and automated deployments. 

•       Support testing, migration, production deployment, runbooks and client knowledge transfer. 

Requirements

Mandatory Qualifications 

•       A minimum of 10 years of professional experience working in the IT industry or performing IT-related roles. 

•       A valid and active Government of Canada Reliability, Secret or Top Secret security clearance. 

•       Significant experience in data engineering, ETL/ELT or data integration. 

•       Demonstrated hands-on Databricks experience. 

•       Strong Python, SQL, Apache Spark and/or PySpark experience. 

•       Experience designing enterprise pipelines and cloud-based data platforms, preferably Azure. 

•       Experience with data quality, troubleshooting and performance optimization. 

•       Experience with Git and modern software development practices. 

 

Technical Skills 

•       Databricks 

•       Lakeflow 

•       Delta Lake 

•       Unity Catalog 

•       Apache Spark / PySpark 

•       Python 

•       SQL 

•       ETL/ELT 

•       Batch and streaming processing 

•       Medallion architecture 

•       Azure data services 

•       Git and CI/CD 

 

Assets 

•       Lakeflow Connect and Auto Loader 

•       Terraform or Databricks Asset Bundles 

•       Azure DevOps or GitHub 

•       Microsoft Purview 

•       On-premises source integration 

•       Migration from SAS, Synapse, DataStage, DB2, Oracle, SQL Server, Teradata or Netezza 

•       Government of Canada delivery experience 

•       Bilingualism in English and French 

Certifications 

Target Certification 

•       Databricks Certified Data Engineer Professional. 

 

Candidates who do not currently hold the target certification may still be considered based on their experience. Candidates are not expected to obtain the certification immediately while 49 Solutions is building its prospective team. If a specific certification becomes required for an opportunity, candidates must be willing to obtain it at their own expense before being submitted for that opportunity. 

Additional Asset Certifications 

•       Databricks EDW/ETL migration training 

•       Databricks Unity Catalog or data governance training 

•       Relevant Microsoft Azure data certifications 

•       Additional advanced Databricks certifications 

 

Security Requirement 

Candidates must hold a valid and active Government of Canada Reliability, Secret or Top Secret security clearance. 

 

Location 

Ottawa, Ontario, Canada. Engagements may be remote, hybrid, or performed at a Government of Canada location. Candidates located in Toronto or Montreal are also encouraged to apply, provided they are willing and able to travel to Ottawa for onsite meetings approximately once per month, as required. 

 

Work arrangements will depend on the client, project and security requirements. 

 

Use of Artificial Intelligence and Applicant Privacy 

Use of Artificial Intelligence (AI tools): 49 Solutions may use approved, secure, and private enterprise AI tools, including Microsoft 365 Copilot, to support recruitment and proposal activities. Information processed using our approved enterprise AI tools is not used to train public AI models or underlying foundation models. Personal contact information (address, email address and phone numbers) will be removed before uploading into the enterprise AI environment. Personal Information shall not be entered into public or consumer AI systems, and our use of enterprise AI is subject to applicable privacy requirements, including PIPEDA, as well as organizational security, retention, and deletion policies. 

By submitting an application or CV to 49 Solutions, you consent to the collection and use of your information for staffing, recruitment, proposal, contracting and placement purposes. AI use for these purposes is optional. If you prefer that your CV not be processed using AI, please let us know. You can opt out of AI use and still apply for opportunities, remain in our candidate database, work with 49 Solutions, and be considered for current and future opportunities. 

Consent may be withdrawn at any time, subject to applicable legal, contractual, operational, and record-keeping requirements. For more information, our full Privacy Policy is available upon request. 

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Ottawa, Ontario, Canada

Location Ottawa, Ontario, Canada. Engagements may be remote, hybrid, or performed at a Government of Canada location. Candidates located in Toronto or Montreal are also encouraged to apply, provided they are willing and able to travel to Ottawa for onsite meetings approximately once per month, as required. Work arrangements will depend on the client, project and security requirements.
Work authorization
• A minimum of 10 years of professional experience working in the IT industry or performing IT-related roles. • A valid and active Government of Canada Reliability, Secret or Top Secret security clearance. • Significant experience in data engineering, ETL/ELT or data integration.
More source context
Security Requirement Candidates must hold a valid and active Government of Canada Reliability, Secret or Top Secret security clearance. Location

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.