Time since we first saw it
Day 1
Early. Similar jobs usually come down between day 5 and day 54.
From 10,704 similar postings that came down. Coming down is not always a hire.
Guangzhou, CN
Actively hiring, first seen by us 1 day agoDesign, develop and maintain ETL pipelines feeding the Amazon S3 data lake
Implement data validation and quality checks throughout the ETL process
Build and schedule automated workflows in Apache Airflow
Run ad-hoc querying and analysis in Amazon Athena and tune query performance
Troubleshoot pipeline issues, bottlenecks and data quality problems
Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data lake on Amazon S3.
Implement data validation and quality checks to ensure the accuracy and consistency of data throughout the ETL process.
Develop and maintain automated workflows using Apache Airflow to schedule and orchestrate data processing tasks
Utilize Amazon Athena for ad-hoc querying and analysis of data stored in Amazon S3, optimizing query performance and efficiency.
Identify and resolve data pipeline issues, performance bottlenecks, and data quality concerns in a timely manner.
Bachelor's degree in Computer Science, Information Technology, or a related field.
Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow.
Proficiency in Python programming for data manipulation and scripting.
Basic understanding of data modelling, SQL, and database concepts.
Qualifications • Bachelor's degree in Computer Science, Information Technology, or a related field. • Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow. • Proficiency in Python programming for data manipulation and scripting. • Basic understanding of data modelling, SQL, and database concepts. • Excellent problem-solving and troubleshooting skills. • Strong communication and teamwork abilities. • Eagerness to learn and adapt to new technologies and tools. Preferred Qualifications (not mandatory but a plus): • Experience with cloud platforms like AWS. • Familiarity with distributed computing frameworks (e.g., Apache Spark). • Knowledge of data warehousing concepts. • Previous experience with data visualization tools (e.g., Tableau, Power BI). • Previous experience with ML. • Previous experience with Terraform.
From the employer’s posting.
Our strategy, which combines cross-border capabilities and leading wealth management expertise, helps us deliver our purpose - to drive commerce and prosperity through our unique diversity.
In the employer’s words · Read in context
Actively hiringFirst seen by us 1 day ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 1
Early. Similar jobs usually come down between day 5 and day 54.
From 10,704 similar postings that came down. Coming down is not always a hire.
38 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Job Summary We are seeking a highly motivated Data Engineer to join our dynamic Data Engineering team. As a Data Engineer, you will play a crucial role in managing and optimizing our data infrastructure, ensuring the reliability and availability of data for our analytics and business intelligence needs. You will work with cutting-edge technologies including Amazon S3, Amazon Athena, Apache Airflow, and Python to build and maintain data pipelines. Key Responsibilities
Key Responsibilities • Data Pipeline Development: Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data lake on Amazon S3. • Data Quality Assurance: Implement data validation and quality checks to ensure the accuracy and consistency of data throughout the ETL process. • Amazon Athena Expertise: Utilize Amazon Athena for ad-hoc querying and analysis of data stored in Amazon S3, optimizing query performance and efficiency. • Automation: Develop and maintain automated workflows using Apache Airflow to schedule and orchestrate data processing tasks, ensuring timely and reliable data delivery. • Python Programming: Write clean and efficient Python code to support data transformation, integration, and data engineering tasks. • Data Architecture: Collaborate with senior data engineers to design and evolve the data architecture, ensuring scalability and performance of the data infrastructure. • Documentation: Maintain comprehensive documentation of data pipelines, workflows, and processes for future reference. • Troubleshooting: Identify and resolve data pipeline issues, performance bottlenecks, and data quality concerns in a timely manner. • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide data engineering support. Regulatory & Business Conduct
Qualifications • Bachelor's degree in Computer Science, Information Technology, or a related field. • Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow. • Proficiency in Python programming for data manipulation and scripting. • Basic understanding of data modelling, SQL, and database concepts. • Excellent problem-solving and troubleshooting skills. • Strong communication and teamwork abilities. • Eagerness to learn and adapt to new technologies and tools. Preferred Qualifications (not mandatory but a plus): • Experience with cloud platforms like AWS. • Familiarity with distributed computing frameworks (e.g., Apache Spark). • Knowledge of data warehousing concepts. • Previous experience with data visualization tools (e.g., Tableau, Power BI). • Previous experience with ML. • Previous experience with Terraform.
• Bachelor's degree in Computer Science, Information Technology, or a related field. • Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow. • Proficiency in Python programming for data manipulation and scripting. • Basic understanding of data modelling, SQL, and database concepts. • Excellent problem-solving and troubleshooting skills. • Strong communication and teamwork abilities. • Eagerness to learn and adapt to new technologies and tools. Preferred Qualifications (not mandatory but a plus): • Experience with cloud platforms like AWS. • Familiarity with distributed computing frameworks (e.g., Apache Spark). • Knowledge of data warehousing concepts. • Previous experience with data visualization tools (e.g., Tableau, Power BI). • Previous experience with ML. • Previous experience with Terraform. About Standard Chartered
Complete your application on jobs.standardchartered.com. The employer’s form will show what is required.
Already applied? Track this application
We are seeking a highly motivated Data Engineer to join our dynamic Data Engineering team. As a Data Engineer, you will play a crucial role in managing and optimizing our data infrastructure, ensuring the reliability and availability of data for our analytics and business intelligence needs. You will work with cutting-edge technologies including Amazon S3, Amazon Athena, Apache Airflow, and Python to build and maintain data pipelines.
• Data Pipeline Development: Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data lake on Amazon S3.
• Data Quality Assurance: Implement data validation and quality checks to ensure the accuracy and consistency of data throughout the ETL process.
• Amazon Athena Expertise: Utilize Amazon Athena for ad-hoc querying and analysis of data stored in Amazon S3, optimizing query performance and efficiency.
• Automation: Develop and maintain automated workflows using Apache Airflow to schedule and orchestrate data processing tasks, ensuring timely and reliable data delivery.
• Python Programming: Write clean and efficient Python code to support data transformation, integration, and data engineering tasks.
• Data Architecture: Collaborate with senior data engineers to design and evolve the data architecture, ensuring scalability and performance of the data infrastructure.
• Documentation: Maintain comprehensive documentation of data pipelines, workflows, and processes for future reference.
• Troubleshooting: Identify and resolve data pipeline issues, performance bottlenecks, and data quality concerns in a timely manner.
• Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide data engineering support.
Regulatory & Business Conduct
• Display exemplary conduct and live by the Group’s Values and Code of Conduct.
• Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct.
• Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.
• Data Pipeline Development
• Data Quality Assurance
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Strong knowledge of Amazon S3, Amazon Athena, and Apache Airflow.
• Proficiency in Python programming for data manipulation and scripting.
• Basic understanding of data modelling, SQL, and database concepts.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and teamwork abilities.
• Eagerness to learn and adapt to new technologies and tools.
Preferred Qualifications (not mandatory but a plus):
• Experience with cloud platforms like AWS.
• Familiarity with distributed computing frameworks (e.g., Apache Spark).
• Knowledge of data warehousing concepts.
• Previous experience with data visualization tools (e.g., Tableau, Power BI).
• Previous experience with ML.
• Previous experience with Terraform.
We're a global bank connecting clients to our differentiated network, offering growth opportunities in the world's most dynamic markets. Our strategy, which combines cross-border capabilities and leading wealth management expertise, helps us deliver our purpose - to drive commerce and prosperity through our unique diversity.
Over our 170-year history, and across a unique geographical footprint connecting Asia, Africa and the Middle East to each other and the world, we've built a bank like no other, with diverse capabilities and partnerships that set us apart.
Visit our careers website to learn more about us: www.sc.com/careers.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Guangzhou, CN
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.