Back to jobs

Senior Data Engineer

Sydney · North Sydney, New South Wales, Australia

Actively hiring, first seen by us 12 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
Location type: Hybrid
From the employer’s posting
Employment
Full-time — employment source
Employment type: Full-time
From the employer’s posting
Team
Data — team source

What you’ll work on

Full posting

Want to put your stamp on a data platform?

  • Own the data platform roadmap, engineering standards, CI/CD and access governance

  • Design and lead the build of scalable ELT pipelines on Azure Databricks

  • Lead the data workstream of the core lending platform migration, reconciling outputs

  • Build and extend a curated, dimensional data model for self-serve data

From the employer’s posting
Want to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two other engineers to develop and plenty of room to shape how data works at Shift.
Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog
Design and lead the build of robust, scalable ELT pipelines on Azure Databricks
Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering
Build and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data

Before you apply

Sponsorship
Visa sponsorship not confirmed — sponsorship source
Do you currently have the legal right to work in Australia or New Zealand without employer sponsorship?
From the employer’s application form
Apply at Shift

Posting record

Report an error

Actively hiringFirst seen by us 12 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 10, 202612 days ago
Recorded sightings
11
Last seen by us
Nov 20, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 12

Similar jobs usually come down between day 6 and day 56.

From 14,771 similar postings that came down. Coming down is not always a hire.

Shift is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Spark
Where the posting names them
- 7+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog) - Strong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles) - A track record of lifting standards on an existing platform, not just building something new on a clean slate
About the role: Want to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two other engineers to develop and plenty of room to shape how data works at Shift. What you’ll do:
- Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog - Design and lead the build of robust, scalable ELT pipelines on Azure Databricks - Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering
What you’ll bring: - 7+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog) - Strong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles)

Your next step

Complete your application on jobs.ashbyhq.com. The employer’s form will show what is required.

Applying through Ashby

  • No account needed. “Autofill from resume” at the top of the form fills the key fields from your file.

Already applied? Track this application

Job description

View original posting ↗

Who is Shift?

Shift provides business finance to small, established and corporate sized businesses in Australia, including Business Overdraft, Equipment Line, Asset Finance, Term Loan and Trade Account. Founded in 2014, Shift has funded more than 30,000 Australian businesses.

At Shift, our unique approach to product innovation combined with our collaborative culture means you can build your career in a supportive environment. You’ll be joining a diverse team of over 300 people who are always looking to deliver better outcomes for Australian businesses.

About the role:

Want to put your stamp on a data platform? You’ll own our Azure Databricks platform, set its standards and roadmap, and lead the data side of a core lending system migration. You’ll be the senior engineer in a small team, with two other engineers to develop and plenty of room to shape how data works at Shift.

 

What you’ll do:

  • Own the data platform roadmap and engineering standards, including CI/CD, separate environments, automated testing, monitoring and access governance through Unity Catalog

  • Design and lead the build of robust, scalable ELT pipelines on Azure Databricks

  • Lead the data workstream for our core lending platform migration: remap pipelines and models, and reconcile outputs before and after cutover alongside Engineering

  • Build and extend a curated, dimensional data model that becomes the default place the business goes for trusted, self-serve data

  • Lift data quality, freshness and alerting so issues are caught before the business notices them

  • Keep the platform cost-efficient through cluster optimisation, job orchestration and smart use of compute

  • Mentor and develop other data engineers through code review, pairing and clear standards

  • Partner with analysts, data scientists, product managers and Engineering to turn business needs into data products people trust

 

What you’ll bring:

  • 7+ years in data engineering, with deep hands-on experience on Azure Databricks (Spark, Delta Lake, Unity Catalog)

  • Strong Python and SQL, plus experience with CI/CD and deploying pipelines as code (Azure DevOps or GitHub, Databricks Asset Bundles)

  • A track record of lifting standards on an existing platform, not just building something new on a clean slate

  • Solid dimensional modelling experience (star schemas, conformed dimensions, medallion architecture)

  • Experience mentoring engineers and leading technical decisions through design and code review

  • The ability to explain technical direction clearly to non-technical stakeholders, and an instinct to work across teams rather than in a silo

  • Experience leading the data side of a core system migration is a strong plus

Key benefits:

  • Hybrid working: we’re headquartered in North Sydney with state-based workplaces and offer a hybrid work policy. Our offices have spaces for collaboration, socialising and focused work.

  • Parental leave: up to 26 weeks paid.

  • Strategy Week: twice a year the whole team comes together to hear the business strategy and product and technology roadmap first-hand, with fortnightly all-company business updates in between.

  • Flat structure: everyone can learn from each other and senior leaders across the business.

  • Wellbeing: benefits supporting your physical, psychological and financial wellbeing, from a day off on your birthday to end of trip facilities.

Additional information:
If you don’t meet all the qualifications or skills but think you’d be a great fit, please apply anyway.

Learn more about working at Shift at shift.com.au/careers.

#LI-Hybrid

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

North Sydney, New South Wales, Australia

Key benefits: - Hybrid working: we’re headquartered in North Sydney with state-based workplaces and offer a hybrid work policy. Our offices have spaces for collaboration, socialising and focused work. - Parental leave: up to 26 weeks paid.
More source context
Learn more about working at Shift at shift.com.au/careers. #LI-Hybrid
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.