Bangalore - Manyata Tech Park Road
Live, first seen by us 1 day agoEmployment type in the employer’s posting: Full timeFrom the employer’s posting
Design and build end-to-end data solutions for business objectives
Develop data transformations, cleansing and aggregation logic in ETL tools, dbt, PySpark and SQL
Lead or take part in ETL strategy and technical solution definition
Test, review and debug pipelines, dbt models and PySpark jobs
Improve team development processes to speed delivery and lower cost
build end-to-end data-centric solutions to address them
Develop complex data transformations, data cleansing and data aggregation logic using Ab-Initio or any other ETL tools, DBT, PySpark and SQL.
Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
Ensure high-quality code by performing thorough testing, code reviews and debugging pipelines, internal framework and components, dbt models and PySpark jobs.
Improve team development related processes that accelerate delivery, drive innovation, lower cost and improve quality.
8+ years of experience in design or development in Analytics and Data Warehousing projects.
Bachelor’s degree in engineering in Computer Science/Information Technology
Experience using AI tools such as Claude/Roo/Cline
Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using Big Data and Data Warehouse platforms (e.g. Teradata, Snowflake). Preferably with at least 8 years of hands-on experience in a Data Engineering role.
Experience in building data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, S3, etc.). Preferably with 3+ years of hands-on experience and an AWS Certified Data Engineer certification.
Proficient in SQL scripting, writing complex SQLs for building data pipelines on Teradata, Snowflake and Oracle.
Education/Qualifications Bachelor’s degree in engineering in Computer Science/Information Technology If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
Day 1
Early. Similar jobs usually come down between day 6 and day 54.
At Commonwealth Bank, jobs usually come down by about day 13.
From 11,508 similar postings that came down, and 93 of Commonwealth Bank’s. Coming down is not always a hire.
20 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Contribute to the full development life cycle, including requirement analysis, functional design, technical design, programming, testing, documentation, implementation and ongoing technical support for agile projects. - Contribute to projects/CRs utilising Snowflake, DBT, Python, PySpark, AWS cloud technologies, Ab-Initio or any ETL tools, Teradata and Oracle. - Understand our customers' core business objectives and build end-to-end data-centric solutions to address them.
- Experience in building data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, S3, etc.). Preferably with 3+ years of hands-on experience and an AWS Certified Data Engineer certification. - Strong Unix/Linux Shell scripting and programming skills. - Proficient in SQL scripting, writing complex SQLs for building data pipelines on Teradata, Snowflake and Oracle.
- Lead or participate in the definition, execution and communication of ETL strategy and technical solution. - Develop complex data transformations, data cleansing and data aggregation logic using Ab-Initio or any other ETL tools, DBT, PySpark and SQL. - Ensure high-quality code by performing thorough testing, code reviews and debugging pipelines, internal framework and components, dbt models and PySpark jobs.
- PySpark: Proven experience developing scalable, distributed data processing pipelines using PySpark. - SQL: Advanced proficiency in writing complex, performant SQL for data transformation, analysis and pipeline development. - Teradata: Solid experience with Teradata data warehousing, including utilities, query performance tuning and data modelling.
- Strong Unix/Linux Shell scripting and programming skills. - Proficient in SQL scripting, writing complex SQLs for building data pipelines on Teradata, Snowflake and Oracle. - Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
- Experience in development, production support and troubleshooting issues. - Experience in process optimisation (e.g. SQL, ETL). - Experience with Big Data platforms for ETL development on the AWS cloud platform, using PySpark on EMR and Glue.
- Experience with Big Data platforms for ETL development on the AWS cloud platform, using PySpark on EMR and Glue. - Should have experience with Teradata and Oracle SQL database programming, SQL performance tuning, and relational model analysis. - Good automation skills in areas such as data ingestion, APIs, file transfers.
Impact & Contribution: - Passionate about building next generation cloud data platforms (Snowflake, AWS) and data pipeline solutions across the bank. - Enthusiastic and able to contribute to, and learn from, the wider engineering talent in the team.
- dbt: Strong experience building modular, tested and documented data transformation models using dbt, including incremental models and CI/CD-driven workflows. - AWS: Hands-on experience building cloud data solutions on AWS, including S3, Glue, EMR / EMR Serverless, Lambda, Step Functions / MWAA (Airflow), EventBridge, SQS, Kinesis, MSK/Kafka, Redshift, Athena, Iceberg and IAM. AWS certification (e.g. AWS Certified Data Engineer) preferred. - PySpark: Proven experience developing scalable, distributed data processing pipelines using PySpark.
- Data Quality Frameworks: Implementing validation, cleansing, and reconciliation logic. - Experience in building data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, S3, etc.). Preferably with 3+ years of hands-on experience and an AWS Certified Data Engineer certification. - Strong Unix/Linux Shell scripting and programming skills.
- Experience in process optimisation (e.g. SQL, ETL). - Experience with Big Data platforms for ETL development on the AWS cloud platform, using PySpark on EMR and Glue. - Should have experience with Teradata and Oracle SQL database programming, SQL performance tuning, and relational model analysis.
- Develop complex data transformations, data cleansing and data aggregation logic using Ab-Initio or any other ETL tools, DBT, PySpark and SQL. - Ensure high-quality code by performing thorough testing, code reviews and debugging pipelines, internal framework and components, dbt models and PySpark jobs. - Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
- Snowflake: Hands-on experience designing and building data solutions on Snowflake, including virtual warehouses, streams, tasks, Snowpipe, time travel and performance optimisation. - dbt: Strong experience building modular, tested and documented data transformation models using dbt, including incremental models and CI/CD-driven workflows. - AWS: Hands-on experience building cloud data solutions on AWS, including S3, Glue, EMR / EMR Serverless, Lambda, Step Functions / MWAA (Airflow), EventBridge, SQS, Kinesis, MSK/Kafka, Redshift, Athena, Iceberg and IAM. AWS certification (e.g. AWS Certified Data Engineer) preferred.
- Good automation skills in areas such as data ingestion, APIs, file transfers. - Knowledge and experience with Dev SecOps practices and tools, including CI/CD for dbt models and data pipelines. Education/Qualifications
Must have Skills - Snowflake: Hands-on experience designing and building data solutions on Snowflake, including virtual warehouses, streams, tasks, Snowpipe, time travel and performance optimisation. - dbt: Strong experience building modular, tested and documented data transformation models using dbt, including incremental models and CI/CD-driven workflows.
- Experience using AI tools such as Claude/Roo/Cline - Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using Big Data and Data Warehouse platforms (e.g. Teradata, Snowflake). Preferably with at least 8 years of hands-on experience in a Data Engineering role. - Extensive experience in ETL tools like GDE, Express-IT, Control centre, Mhub, Conduct-IT and Meta programming.
- AWS: Hands-on experience building cloud data solutions on AWS, including S3, Glue, EMR / EMR Serverless, Lambda, Step Functions / MWAA (Airflow), EventBridge, SQS, Kinesis, MSK/Kafka, Redshift, Athena, Iceberg and IAM. AWS certification (e.g. AWS Certified Data Engineer) preferred. - PySpark: Proven experience developing scalable, distributed data processing pipelines using PySpark. - SQL: Advanced proficiency in writing complex, performant SQL for data transformation, analysis and pipeline development.
Complete your application on cba.wd3.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed one other Senior Data Engineer job there since July 2026. It came down after 93 days.
New Data Engineer postings at the employers we follow are up 8% over the last 5 weeks compared with the 5 before.
Each bar is one week of new postings. The darkest bars are the last 5 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Organization:
Commonwealth Bank of Australia is the largest and number one bank in Australia, serving over 17 million customers. We maintain a high-trust brand reputation built on financial strength, innovation, and community impact. As of July 2025, CBA holds market cap of approximately USD 195.7 billion, ranking us among the top 100 most valuable companies globally. Our leadership in digital banking, customer safety, and responsible AI reflects our commitment to building a brighter future for all. Our values are reflected in our high-trust brand reputation. CBA is consistently ranked among Australia’s most valuable and trusted brands.
Job Title: Senior Data Engineer
Location: Bangalore - Manyata Tech Park
Business & Team: Retail Tech
Impact & Contribution:
Roles and Responsibilities
Must have Skills
Essential Skills:
In addition to the mandatory skills above, we use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure to some of these (or equivalents) will set you up for success in this team.
Education/Qualifications
Bachelor’s degree in engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bangalore - Manyata Tech Park Road
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.