Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
Build and support highly available data pipelines and storage solutions
Work with clients to determine data processing and access needs
Automate data infrastructure and deployments
Deliver software using pair programming, TDD and CI/CD
Mentor client team members and advocate agile practices
Creation and support of highly available data pipelines and storage solutions
Working with the client and the team to determine data processing and access needs
Automation of data infrastructure and deployments.
Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
Mentoring client team members.
Significant experience working on data pipelines, platforms and projects.
Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
Strong background in at least one programming language, Python or Scala preferable.
Strong experience in SQL and data modeling.
Working with a variety of databases, data warehouses and distributed file systems in production environments.
Required Skills ● Significant experience working on data pipelines, platforms and projects. ● Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure). ● Strong background in at least one programming language, Python or Scala preferable. ● Working with a variety of databases, data warehouses and distributed file systems in production environments. ● Strong experience in SQL and data modeling. ● Exposure with data processing at scale. ● Knowledge about GDPR and data security. Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools. ● Understanding and being able to support data scientists or business intelligence teams - in data prep, mentoring and support functions. ● Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
Description
Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for
blue-chip enterprise and public sector clients across a range of industry sectors. We work on important
projects for our clients, deliver market-leading propositions across the digital, online and mobile
channels, and are recognised for our leadership in the application of agile and lean delivery methods to
assure delivery. We have offices in Australia, India, South Africa, the UK, the EU and the USA.
We’re looking for Data Engineers with proven senior-level experience to join the Equal Experts
network.
Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of
data, usually at scale, and are familiar with standing-up analytics clusters.
This role involves using modern agile technical practices - including Continuous Integration and
Deployment, TDD, and XP - to deliver timely and pragmatic solutions, as well as helping others to do
their jobs in a more effective way.
This role involves working in teams that use modern agile technical practices - including continuous
integration and deployment and fast feedback loops - to deliver timely and pragmatic solutions, as well
as helping others to do their jobs in a more effective way.
Responsibilities
● Working with the client and the team to determine data processing and access needs and how
best to deliver them.
● Creation and support of highly available data pipelines and storage solutions (e.g. data
warehouses).
● Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
● Automation of data infrastructure and deployments.
● Advocating agile practices to the client organisation.
● Mentoring client team members.
● Helping improve the team and clients’ data capabilities.
Required Skills
● Significant experience working on data pipelines, platforms and projects.
● Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP,
Azure).
● Strong background in at least one programming language, Python or Scala preferable.
● Working with a variety of databases, data warehouses and distributed file systems in production
environments.
● Strong experience in SQL and data modeling.
● Exposure with data processing at scale.
● Knowledge about GDPR and data security. Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools.
● Understanding and being able to support data scientists or business intelligence teams - in data
prep, mentoring and support functions.
● Strong collaboration and communication skills, including the ability to communicate effectively
while working remotely with globally distributed teams.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting