Back to jobs

#EG Senior AI Data Engineer

Reads like an AI Engineer role: building products on existing AI models.

Pay
Pay not listed
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting

You are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.

Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.

  • Design and implement the agent framework for orchestration, state and memory

  • Build specialized agents for ingestion, profiling and table registration

  • Build data transformation workflows and curated datasets with Trino SQL

  • Validate data quality, detect anomalies and generate reconciliation reports

  • Optimize Iceberg tables and Parquet files and recommend partitioning

From the employer’s posting
You are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.
Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.
Design and implement the foundational agent framework that provides
Discover Iceberg catalogs and schemas Profile datasets Generate metadata and lineage Ingest data from databases, APIs, files, and streams
Generate Trino SQL Build transformation workflows Create curated and business-ready datasets
Validate schemas and data integrity Detect anomalies Generate reconciliation reports
Recommend partitioning strategies Optimize Iceberg tables and Parquet files

What you’ll bring

All qualifications

Core experience

  • Experience with Generative AI, Agentic AI, or LLM-based solutions.
  • Proficiency in Python, including FastAPI, Pydantic and Pandas.
  • Experience designing and implementing AI Harness or multi-agent frameworks.
  • Hands-on experience with LangChain & LangGraph.
  • Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
  • Experience building data ingestion, transformation, and orchestration pipelines.
Qualification wording
Experience with Generative AI, Agentic AI, or LLM-based solutions.
Proficiency in Python, including FastAPI, Pydantic and Pandas.
Experience designing and implementing AI Harness or multi-agent frameworks.
Hands-on experience with LangChain & LangGraph.
Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
Experience building data ingestion, transformation, and orchestration pipelines.
Apply at NCS

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Oct 19, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Similar jobs usually come down between day 1 and day 15.

From 1,368 similar postings that came down. Coming down is not always a hire.

NCS is hiring

46 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • dbt
  • DuckDB
  • Iceberg
  • Trino
  • FastAPI
  • pandas
Where the posting names them
- Trino SQL scripts and views - Python data pipeline code - Data quality validation suites
- Experience with Generative AI, Agentic AI, or LLM-based solutions. - Proficiency in Python, including FastAPI, Pydantic and Pandas. - Experience designing and implementing AI Harness or multi-agent frameworks.
- Register and maintain Iceberg tables - Generate Trino SQL - Build transformation workflows
- Iceberg table definitions and schemas - Trino SQL scripts and views - Python data pipeline code
- Proven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability. - Familiar with modern data engineering technologies, including DuckDB, dbt, and related engineering tools for data transformation, modelling, and pipeline development. - Senior engineers will be expected to have demonstrated evidence of leading technical designs, guiding junior engineering team members, working independently with clients and delivery teams, and translating AI/data requirements into scalable, secure, and deployable solutions.
Role Summary You are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet. Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.
- Create Parquet datasets - Register and maintain Iceberg tables - Generate Trino SQL
- Recommend partitioning strategies - Optimize Iceberg tables and Parquet files - Classify sensitive information
Expected Deliverables - Iceberg table definitions and schemas - Trino SQL scripts and views
- Hands-on experience with LangChain & LangGraph. - Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures. - Experience building data ingestion, transformation, and orchestration pipelines.
- Generate reconciliation reports - Analyze Trino workloads - Recommend partitioning strategies

Your next step

Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.

Applying through SmartRecruiters

  • Uploading your resume fills in the application form for you, so check what it filled before you send.

Already applied? Track this application

Job description

View original posting ↗

Job Description

Role Summary

You are an autonomous AI Engineer, responsible for creating the harness for designing and building the AI harness, agent framework, and reusable engineering components required to operate a modern data platform based on Apache Iceberg, Trino, and Parquet.

Your primary responsibility is not only to build data pipelines, but also to establish the agentic execution framework (AI Harness) that enables multiple specialized agents to collaborate, execute tasks, maintain state, orchestrate workflows, and deliver end-to-end data engineering capabilities.

Depending on your level of experience, your focus in the team will be on either task execution, independent delivery, or technical leadership.

Key Responsibilities

AI Harness Development

Design and implement the foundational agent framework that provides:

  • Agent orchestration and coordination
  • Workflow execution and state management
  • Memory and context handling
  • Tool and function calling
  • Agent-to-agent communication
  • Human approval workflows
  • Logging and audit trails
  • Error handling and recovery
  • Security and access controls
  • Observability and monitoring

The harness must support autonomous and multi-agent execution patterns.

Specialized Agents Creation

The agents will need to perform the following:

  • Discover Iceberg catalogs and schemas
  • Profile datasets
  • Generate metadata and lineage
  • Ingest data from databases, APIs, files, and streams
  • Create Parquet datasets
  • Register and maintain Iceberg tables
  • Generate Trino SQL
  • Build transformation workflows
  • Create curated and business-ready datasets
  • Validate schemas and data integrity
  • Detect anomalies
  • Generate reconciliation reports
  • Analyze Trino workloads
  • Recommend partitioning strategies
  • Optimize Iceberg tables and Parquet files
  • Classify sensitive information
  • Manage metadata and lineage
  • Apply retention and compliance policies
  • Monitor pipelines and agent activities
  • Detect failures and bottlenecks
  • Generate alerts and operational insights

Expected Deliverables

  • Iceberg table definitions and schemas
  • Trino SQL scripts and views
  • Python data pipeline code
  • Data quality validation suites
  • Metadata and lineage documentation
  • CI/CD deployment artifacts
  • Monitoring and observability configurations
  • Technical documentation and runbooks

Qualifications

Skills and Experience

The candidate should demonstrate expertise in:

  • Minimum 4++ years of relevant Data Engineering experience
  • Experience with Generative AI, Agentic AI, or LLM-based solutions.
  • Proficiency in Python, including FastAPI, Pydantic and Pandas.
  • Experience designing and implementing AI Harness or multi-agent frameworks.
  • Hands-on experience with LangChain & LangGraph.
  • Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
  • Experience building data ingestion, transformation, and orchestration pipelines.
  • Strong knowledge of metadata management, data lineage, and data governance practices.
  • Experience developing REST APIs, SDKs, and reusable engineering frameworks.
  • Experience with observability, monitoring, tracing, and operational support practices.
  • Strong understanding of distributed systems, event-driven architectures, and microservices patterns.
  • Proven ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.
  • Familiar with modern data engineering technologies, including DuckDB, dbt, and related engineering tools for data transformation, modelling, and pipeline development.
  • Senior engineers will be expected to have demonstrated evidence of leading technical designs, guiding junior engineering team members, working independently with clients and delivery teams, and translating AI/data requirements into scalable, secure, and deployable solutions.

Additional Information

We are driven by our AEIOU beliefs—Adventure, Excellence, Integrity, Ownership, and Unity—and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.

 

Together, we make the extraordinary happen.

 

Learn more about us at ncs.co and visit our LinkedIn career site.

 

Scam Alert

 

We are aware of fraudulent job offers and impersonations of NCS recruiters. Phishing emails using convincing-looking but fake addresses are also commonly used to trick you into thinking that they come from official NCS sources.

 

Please note that all official communications from NCS Group will only be sent from verified corporate email addresses. Always check that the sender’s email address ends with the genuine NCS domain, @ncs.com.sg and beware of extra letters, symbols or misspellings. When in doubt, verify the sender’s identity by contacting us at reachus@ncs.com.sg.

Company Description

NCS is a leading technology services firm that operates across the Asia Pacific region in over 20 cities, providing consulting, digital services, technology solutions, and more. We believe in harnessing the power of technology to achieve extraordinary things, creating lasting value and impact for our communities, partners, and people. Our diverse workforce of 15,000 has delivered large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region. 

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Singapore, Singapore

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.