> job detail
S
👽Other
AI Data Engineer- (Guangzhou, CN)
Standard Chartered · Guangzhou, CN
// classified as
Other (Adjacent or hard to classify.)
posted
1d ago
location
Guangzhou, CN
languages
python, sql
tools
databricks, delta, iceberg
> stack
pythonsqldatabricksdeltaicebergkafkas3spark
> education
masters
> description
<div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Key Responsibilities</b></H2>
</div><div><p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">A data engineer who builds the pipelines and data infrastructure that feed AI/ML and agentic applications, owning ingestion through to retrieval-ready, feature-ready data.</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Must-have</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Production data pipelines at scale. You've built and operated batch and/or streaming pipelines that other teams depend on, and owned them through schema changes, backfills, and on-call.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Spark and Databricks (or equivalent distributed compute). Comfortable tuning jobs for skew, shuffle, partitioning, and memory under real workloads, and working within a lakehouse platform like Databricks (Delta, Unity Catalog, workflows).</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Object stores as the data backbone. S3 / ADLS / MinIO, with strong grasp of partitioning, file formats (Parquet / Delta / Iceberg), compaction, and the cost and performance tradeoffs that come with them.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Data integration across heterogeneous sources. Databases, APIs, event streams, and files stitched into reliable, coherent flows. This is the core of the role.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Unstructured data. Parsing, chunking, and normalizing documents and multimodal content into something AI systems can actually consume.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• System design. You reason clearly about throughput, latency, consistency, idempotency, and cost, and can defend your decisions.</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Strongly preferred</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Feature engineering for ML, building and serving features with offline/online consistency.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Streaming and big-data stack, including Kafka / Kinesis / Pulsar, Flink, and lakehouse patterns.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Open-source contributions, a signal of depth beyond day-job delivery.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Strong communication skills and an easy-going attitude</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">You'll pick up on the job (preferred, not required)</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Data pipelines, including data ingestion, feature stores, and data quality</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b></b></H2>
</div><div><p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Strategy</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• As the Squad member of AI team, the candidate is expected to participate and drive deliverables associated with Business Use cases. </span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Business</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Understand the Business requirement and execute the solutioning and ensue the delivery commitments are delivered on time and schedule. </span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Processes</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Design and Delivery of AI ML Use cases</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• RAI, Security & Governance</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Model Validation & Improvements</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Stakeholder Management</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">People & Talent</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Manage the team in terms of project assignments and deadlines</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Manage a team dedicated for reviewing models related unstructured and structured data.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Hire, nurture talent as required.</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Risk Management</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Ownership of the delivery, highlighting various risks on a timely manner to the stakeholders.</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Identifying proper remediation plan for the risks with proper risk roadmap.</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Governance</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Awareness and understanding of the regulatory framework, in which the Group operates, and the regulatory requirements and expectations relevant to the role.</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b></b></H2>
</div><div><p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Regulatory & Business Conduct</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Display exemplary conduct and live by the Group’s Values and Code of Conduct. </span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Take personal responsibility for embedding the highest standards of ethics, including regulatory and business conduct, across Standard Chartered Bank. This includes understanding and ensuring compliance with, in letter and spirit, all applicable laws, regulations, guidelines and the Group Code of Conduct. </span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Effectively and collaboratively identify, escalate, mitigate and resolve risk, conduct and compliance matters.</span></p>
<p><strong><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Key stakeholders</span></strong><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Business Stakeholders</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• AIML Engineering Team </span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• AIML Product Team </span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Product Enablement Team</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• SCB Infrastructure Team</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Interfacing Program Team</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Skills and Experience</b></H2>
</div><div><p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Build and maintain pipelines using Python, SQL, Spark</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Write ETL/ELT ingestion into Delta Lake or Iceberg tables</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Implement data quality checks and route failures</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Work with cloud storage and compute (ADLS, S3, Spark)</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Prepare feature-ready datasets for ML and embedding pipelines</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Support data warehouse and data lake environments </span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Work with AI platform and data science teams on data needs</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Monitor production pipelines and trace issues</span></p>
<p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• SQL<br>• Python<br>• ETL and ML concepts<br>• Apache Spark<br>• Azure/AWS fundamentals<br>• Datawarehouse<br>• Datalake knowledge<br>• Distributed Systems Design and Architecture<br></span></p>
<p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">Good to have:<br>• Flink<br>• Vector</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>Qualifications</b></H2>
</div><div><p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• Master’s with specialisation in Technology with certification in AI and ML</span><br><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt;color:black">• 6-10 years relevant of Hands-on Experience in developing and delivering AI solutions</span></p></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>About Standard Chartered</b></H2>
</div><div><p>We're an international bank, nimble enough to act, big enough for impact. For more than 170 years, we've worked to make a positive difference for our clients, communities, and each other. We question the status quo, love a challenge and enjoy finding new opportunities to grow and do better than before. If you're looking for a career with purpose and you want to work for a bank making a difference, we want to hear from you. You can count on us to celebrate your unique talents and we can't wait to see the talents you can bring us.</p>
<p>Our purpose, to drive commerce and prosperity through our unique diversity, together with our brand promise, to be here for good are achieved by how we each live our valued behaviours. When you work with us, you'll see how we value difference and advocate inclusion.</p>
<p>Together we:</p>
<ul>
<li><b>Do the right thing</b> and are assertive, challenge one another, and live with integrity, while putting the client at the heart of what we do</li>
<li><b>Never settle,</b> continuously striving to improve and innovate, keeping things simple and learning from doing well, and not so well</li>
<li><b>Are better together,</b> we can be ourselves, be inclusive, see more good in others, and work collectively to build for the long term</li>
</ul></div></div><div style="padding:10.0px 0.0px;border:1.0px solid transparent"><div style="font-size:14.0px;word-wrap:break-word"><H2 style="font-size:1.0em;margin:0.0px"><b>What we offer</b></H2>
</div><div><p><b>In line with our Fair Pay Charter,</b> we offer a competitive salary and benefits to support your mental, physical, financial and social wellbeing.</p>
<ul>
<li><b>Core bank funding for retirement savings, medical and life insurance,</b> with flexible and voluntary benefits available in some locations.</li>
<li><b>Time-off</b> including annual leave, parental/maternity (20 weeks), sabbatical (12 months maximum) and volunteering leave (3 days), along with minimum global standards for annual and public holiday, which is combined to 30 days minimum.</li>
<li><b>Flexible working</b> options based around home and office locations, with flexible working patterns.</li>
<li><b>Proactive wellbeing support</b> through Unmind, a market-leading digital wellbeing platform, development courses for resilience and other human skills, global Employee Assistance Programme, sick leave, mental health first-aiders and all sorts of self-help toolkits</li>
<li><b>A continuous learning culture</b> to support your growth, with opportunities to reskill and upskill and access to physical, virtual and digital learning.</li>
<li><b>Being part of an inclusive and values driven organisation,</b> one that embraces and celebrates our unique diversity, across our teams, business functions and geographies - everyone feels respected and can realise their full potential.</li>
</ul></div></div></div>