7-11 years of experience in design or development in Analytics and Data Warehousing projects.
Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
Experience in building data pipelines using AWS services in Cloud Ecosystem.
Experience in Python and any other programming language is highly recommended.
Experience in building AI/GenAI powered engineering applications is highly recommended.
Preferred experience
Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
Qualification wording
7-11 years of experience in design or development in Analytics and Data Warehousing projects.
Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
Experience in building data pipelines using AWS services in Cloud Ecosystem.
Experience in Python and any other programming language is highly recommended.
Experience in building AI/GenAI powered engineering applications is highly recommended.
Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
Education & alternatives
- Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
Education Qualification: Bachelor’s in computer science, B. Tech IT, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SAS
Scala
Shell
SQL
Ab Initio
AWS
Cloudera
Hadoop
Hive
OBIEE
Oracle
Spark
Tableau
Teradata
Hugging Face
Where the posting names them
- Experience in building data pipelines using AWS services in Cloud Ecosystem.
- Experience in Python and any other programming language is highly recommended.
- Experience in building AI/GenAI powered engineering applications is highly recommended.
- Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
- Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
Education Qualification: Bachelor’s in computer science, B. Tech IT, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience.
- 7-11 years of experience in design or development in Analytics and Data Warehousing projects.
- Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
- 8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
- Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
- 8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
- Experience in building data pipelines using AWS services in Cloud Ecosystem.
- Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
- Experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
- Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
- Experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
- Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
- Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
- 8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
- Experience in building data pipelines using AWS services in Cloud Ecosystem.
- Experience in Python and any other programming language is highly recommended.
- Experience in building AI/GenAI powered engineering applications is highly recommended.
- Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
- Experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
Complete your application on cba.wd3.myworkdayjobs.com. The employer’s form will show what is required.
Applying through Workday
You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
“Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
Your application status lives in that employer’s Candidate Home, under the same sign-in.
Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Staff Data Engineer Location: Bangalore
This role reports to a Chapter Lead (Engineering Manager) and is key member of the team responsible for all development work.
Impact & Contribution: To ensure the Group achieves sustainable competitive advantage through data & analytics, you will need to play a key role in supporting the BB Tech in executing to the Groups data strategy.
As an Engineer, you will be required to build strong working relationships with key business and stakeholders to improve outcomes, drive engineering standards across the group, identify engineering improvement opportunities to improve our status on risk, compliance, vulnerabilities and general health of our technical solutions, while improving our E2E engineering outcomes to drive better technical outcomes across BB Tech. You will adopt tools and templates used across analytics systems that underpin our data and analytics capabilities for the Group.
Roles & Responsibilities:
Understand our customers' core business objectives and build end-to-end data centric solutions to address them.
Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
Development of data staging, architecture and consuming internal and external application interfaces
Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
Participate in the full lifecycle of agile projects (ideation through implementation)
Designs technical solutions and consumption patterns for business requirements with increasing complexity.
Adhere to the Code of Conduct. The Code of Conduct sets the standards of behavior, actions and decisions we expect from our people.
Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks
Influence and guide stakeholders to ensure that solutions are robust, secure and highly available
Uplift the quality of technical solutions by applying industry best practice
Role model continuous improvement mindset in team and project interactions
Essential Skills:
7-11 years of experience in design or development in Analytics and Data Warehousing projects.
Experience in designing and building end-to-end solutions with the Big data platform, Spark or scala programming.
8 years of Solid experience in ETL pipeline building with spark or scala programming framework with knowledge in developing UNIX Shell Script, Oracle SQL/ PL-SQL.
Experience in building data pipelines using AWS services in Cloud Ecosystem.
Experience in Python and any other programming language is highly recommended.
Experience in building AI/GenAI powered engineering applications is highly recommended.
Experience in utilizing GenAI framework (Langchain, Llama, Hugging Face) and automation applications is highly desirable.
Experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
Experience in ETL Abinitio tools like GDE, Express-IT, Control center, Meta programming is a plus.
Extensive experience with Teradata data warehouses and Cloudera Hadoop. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Tableau, OBIEE, SAS, Apache Spark, Hive
Education Qualification:Bachelor’s in computer science, B. Tech IT, Mathematics, Statistics or equivalent quantitative discipline or comparable industry experience.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 29/11/2026
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.