Back to jobs

Senior AI Data Engineer

Pay
Pay not listed
Work setting
On-site — work setting source
Work setup in the employer’s posting: On-site
From the employer’s posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full-Time
From the employer’s posting

What you’ll work on

Full posting
  • Design and evolve Kimball-style dimensional models and fact tables

  • Build and operate batch and streaming pipelines with idempotent retries and backfills

  • Build embedding generation and incremental re-embedding pipelines for vector stores

  • Own data contracts, schema evolution and pipeline observability checks

  • Implement access control, PII handling, retention and audit at the data layer

From the employer’s posting
Design and evolve dimensional models using Kimball methodology
Build and operate batch and streaming pipelines with orchestration frameworks such as Airflow, Prefect, or Dagster, including backfill, replay, and idempotent-retry semantics.
Build embedding generation and refresh pipelines: chunk materialization, embedding jobs, incremental re-embedding on source change
Own data contracts between producing and consuming systems: schema evolution, compatibility rules, and breaking-change procedure.
Implement access control, PII handling, retention, and audit requirements at the data layer.

What you’ll bring

All qualifications

Core experience

  • 5-10+ years in software engineering or data engineering, with substantial time in production data platform work.
  • SQL: expert-level - window functions, CTEs, query plan reading, and performance tuning on a columnar warehouse.
  • Python: expert-level, production-grade - typing, packaging, dependency management, testing.
  • Experience with Lakehouse table formats (Iceberg, Delta Lake, Hudi) and their maintenance characteristics: compaction, snapshot expiry, schema and partition evolution.

Preferred experience

  • Experience building the data layer beneath production RAG systems, including hybrid search infrastructure and index freshness guarantees.
  • Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists.
  • Experience with AI security, governance, and compliance frameworks.
Qualification wording
5-10+ years in software engineering or data engineering, with substantial time in production data platform work.
SQL: expert-level - window functions, CTEs, query plan reading, and performance tuning on a columnar warehouse.
Python: expert-level, production-grade - typing, packaging, dependency management, testing.
Experience with Lakehouse table formats (Iceberg, Delta Lake, Hudi) and their maintenance characteristics: compaction, snapshot expiry, schema and partition evolution.
Experience building the data layer beneath production RAG systems, including hybrid search infrastructure and index freshness guarantees.
Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists.
Experience with AI security, governance, and compliance frameworks.

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 3, 202675 days ago
Recorded sightings
56
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 75

Up longer than most. Similar jobs usually come down between day 6 and day 56.

At Strategic Systems International, jobs usually come down by about day 69.

From 13,991 similar postings that came down, and 7 of Strategic Systems International’s. Coming down is not always a hire.

Strategic Systems International is hiring

3 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • Python
  • Rust
  • Scala
  • SQL
  • TypeScript
  • AWS
  • Azure
  • dbt
  • Delta Lake
  • GCP
  • Kafka
  • Kubernetes
  • MLflow
  • Prefect
  • Spark
  • Airflow
  • Dagster
  • FastAPI
  • Go
  • Great Expectations
Where the posting names them
Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists. Working knowledge of a second language: TypeScript, Java, Go, Scala, or Rust. Experience with AI security, governance, and compliance frameworks.
We are seeking a Senior AI Data Engineer to design and operate the data foundation that our AI systems depend on. This role owns the movement, modeling, and quality of data from source systems through the warehouse and into the retrieval and feature layers that power LLM pipelines, agentic workflows, and analytical products. The ideal candidate is a rigorous software engineer first and a data specialist second: someone who models a warehouse deliberately, writes production Python that other engineers can extend, and treats pipelines as versioned, tested, observable software rather than scripts. This role partners closely with the AI/ML Data Scientist, who owns model behavior and retrieval strategy.
SQL: expert-level - window functions, CTEs, query plan reading, and performance tuning on a columnar warehouse. Python: expert-level, production-grade - typing, packaging, dependency management, testing. Design: SOLID and domain-driven design applied in real systems; with examples you can walk through.
- Build and operate batch and streaming pipelines with orchestration frameworks such as Airflow, Prefect, or Dagster, including backfill, replay, and idempotent-retry semantics. - Implement ELT transformation layers with tested, documented, version-controlled SQL. - Own data contracts between producing and consuming systems: schema evolution, compatibility rules, and breaking-change procedure.
Data warehousing: demonstrable command of Kimball dimensional modeling - not just familiarity with the vocabulary, but the judgment to choose a grain, resolve a many-to-many relationship, and know when to denormalize. Working knowledge of alternative approaches (Data Vault, One Big Table, Inman) and the tradeoffs against Kimball. SQL: expert-level - window functions, CTEs, query plan reading, and performance tuning on a columnar warehouse. Python: expert-level, production-grade - typing, packaging, dependency management, testing.
Orchestration: Airflow, Prefect, Dagster, or equivalent, in production. Cloud: expert-level on AWS, Azure, or GCP - storage, compute, IAM, networking, and cost management. Platform: containerization, Kubernetes (EKS/AKS/GKE), and CI/CD.
Streaming systems: Kafka, Kinesis, Flink, or Spark Structured Streaming. dbt or an equivalent transformation and testing framework. Data quality tooling (Great Expectations, Soda, or similar) and catalog/lineage platforms.
Platform: containerization, Kubernetes (EKS/AKS/GKE), and CI/CD. Experience with Lakehouse table formats (Iceberg, Delta Lake, Hudi) and their maintenance characteristics: compaction, snapshot expiry, schema and partition evolution. Preferred Qualifications
Experience building the data layer beneath production RAG systems, including hybrid search infrastructure and index freshness guarantees. Streaming systems: Kafka, Kinesis, Flink, or Spark Structured Streaming. dbt or an equivalent transformation and testing framework.
Cloud: expert-level on AWS, Azure, or GCP - storage, compute, IAM, networking, and cost management. Platform: containerization, Kubernetes (EKS/AKS/GKE), and CI/CD. Experience with Lakehouse table formats (Iceberg, Delta Lake, Hudi) and their maintenance characteristics: compaction, snapshot expiry, schema and partition evolution.
Data quality tooling (Great Expectations, Soda, or similar) and catalog/lineage platforms. Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists. Working knowledge of a second language: TypeScript, Java, Go, Scala, or Rust.
Pipeline & ETL/ELT Engineering - Build and operate batch and streaming pipelines with orchestration frameworks such as Airflow, Prefect, or Dagster, including backfill, replay, and idempotent-retry semantics. - Implement ELT transformation layers with tested, documented, version-controlled SQL.
Design: SOLID and domain-driven design applied in real systems; with examples you can walk through. Orchestration: Airflow, Prefect, Dagster, or equivalent, in production. Cloud: expert-level on AWS, Azure, or GCP - storage, compute, IAM, networking, and cost management.
- Implement the preprocessing and feature pipelines that back model training and inference, with train/serve consistency as a design requirement. - Expose data to AI services and applications through well-specified FastAPI or gRPC interfaces. Engineering Craft
dbt or an equivalent transformation and testing framework. Data quality tooling (Great Expectations, Soda, or similar) and catalog/lineage platforms. Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists.

Your next step

Complete your application on strategic-systems-international.breezy.hr. The employer’s form will show what is required.

Applying through Breezy HR

  • No account needed.

Already applied? Track this application

Job description

View original posting ↗

Senior AI Data Engineer

Job Summary

We are seeking a Senior AI Data Engineer to design and operate the data foundation that our AI systems depend on. This role owns the movement, modeling, and quality of data from source systems through the warehouse and into the retrieval and feature layers that power LLM pipelines, agentic workflows, and analytical products.

The ideal candidate is a rigorous software engineer first and a data specialist second: someone who models a warehouse deliberately, writes production Python that other engineers can extend, and treats pipelines as versioned, tested, observable software rather than scripts.

This role partners closely with the AI/ML Data Scientist, who owns model behavior and retrieval strategy.

The boundary: you own the pipeline, the schema, and the guarantees; they own the algorithm, the prompt, and the evaluation.

Key Responsibilities

Data Warehousing & Dimensional Modeling

  • Design and evolve dimensional models using Kimball methodology - star schemas, conformed dimensions, an enterprise bus matrix, and explicit fact-table grain declarations.
  • Implement transaction, periodic snapshot, and accumulate snapshot fact tables as the business process warrants and defend the choice of grain.
  • Manage slowly changing dimensions (Type 1 / 2 / 3, and hybrid variants) with correct effective-dating, surrogate key strategy, and late-arriving dimension handling.
  • Model semi-structured and unstructured sources - documents, transcripts, event streams-into queryable structures without discarding provenance.
  • Maintain a governed semantic layer so that both human analysts and agentic consumers resolve the same metric to the same number.

Pipeline & ETL/ELT Engineering

  • Build and operate batch and streaming pipelines with orchestration frameworks such as Airflow, Prefect, or Dagster, including backfill, replay, and idempotent-retry semantics.
  • Implement ELT transformation layers with tested, documented, version-controlled SQL.
  • Own data contracts between producing and consuming systems: schema evolution, compatibility rules, and breaking-change procedure.
  • Instrument pipelines for observability - freshness, volume, distribution, and schema-drift checks - with alerting that distinguishes a real incident from ordinary variance.
  • Maintain end-to-end lineage from source record to warehouse fact to retrieved chunk.

Data Engineering for AI

  • Build embedding generation and refresh pipelines: chunk materialization, embedding jobs, incremental re-embedding on source change, and index lifecycle management.
  • Operate vector stores (Pinecone, Weaviate, Chroma, Milvus, pgvector) as production data systems - capacity, index build strategy, upsert/delete correctness, and staleness SLAs.
  • Build extraction pipelines over unstructured sources using OCR, document parsers, and vision-language model outputs, treating extraction confidence as a first-class column.
  • Implement the preprocessing and feature pipelines that back model training and inference, with train/serve consistency as a design requirement.
  • Expose data to AI services and applications through well-specified FastAPI or gRPC interfaces.

Engineering Craft

  • Apply SOLID principles and domain-driven design: bounded contexts that mirror the business domains, ubiquitous language shared with stakeholders, aggregates and repositories that keep domain logic out of transport and persistence layers.
  • Maintain meaningful test coverage (unit, contract, and data-quality assertions) and treat an untested pipeline as an unfinished one.
  • Own CI/CD, containerization, and environment promotion for data services.
  • Contribute to code review, architectural decision records, and internal standards.

Governance & Cost

  • Implement access control, PII handling, retention, and audit requirements at the data layer.
  • Manage warehouse and pipeline cost: partitioning, clustering, materialization strategy, and storage tiering.

Collaboration

  • Translate business problems into data models with product and client stakeholders.
  • Mentor junior and mid-level data engineers.


Required Qualifications

5-10+ years in software engineering or data engineering, with substantial time in production data platform work.

Data warehousing: demonstrable command of Kimball dimensional modeling - not just familiarity with the vocabulary, but the judgment to choose a grain, resolve a many-to-many relationship, and know when to denormalize. Working knowledge of alternative approaches (Data Vault, One Big Table, Inman) and the tradeoffs against Kimball.

SQL: expert-level - window functions, CTEs, query plan reading, and performance tuning on a columnar warehouse.

Python: expert-level, production-grade - typing, packaging, dependency management, testing.

Design: SOLID and domain-driven design applied in real systems; with examples you can walk through.

Orchestration: Airflow, Prefect, Dagster, or equivalent, in production.

Cloud: expert-level on AWS, Azure, or GCP - storage, compute, IAM, networking, and cost management.

Platform: containerization, Kubernetes (EKS/AKS/GKE), and CI/CD.

Experience with Lakehouse table formats (Iceberg, Delta Lake, Hudi) and their maintenance characteristics: compaction, snapshot expiry, schema and partition evolution.

Preferred Qualifications

Experience building the data layer beneath production RAG systems, including hybrid search infrastructure and index freshness guarantees.

Streaming systems: Kafka, Kinesis, Flink, or Spark Structured Streaming.

dbt or an equivalent transformation and testing framework.

Data quality tooling (Great Expectations, Soda, or similar) and catalog/lineage platforms.

Familiarity with the model-facing side of the stack - MLflow, Weights & Biases, feature stores - sufficient to collaborate credibly with data scientists.

Working knowledge of a second language: TypeScript, Java, Go, Scala, or Rust.

Experience with AI security, governance, and compliance frameworks.

Open-source contributions to data or AI infrastructure projects.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 861, the most 1,353, and the latest week had 1,022.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Lahore, PK

- Implement transaction, periodic snapshot, and accumulate snapshot fact tables as the business process warrants and defend the choice of grain. - Manage slowly changing dimensions (Type 1 / 2 / 3, and hybrid variants) with correct effective-dating, surrogate key strategy, and late-arriving dimension handling. - Model semi-structured and unstructured sources - documents, transcripts, event streams-into queryable structures without discarding provenance.
More source context
Preferred Qualifications Experience building the data layer beneath production RAG systems, including hybrid search infrastructure and index freshness guarantees. Streaming systems: Kafka, Kinesis, Flink, or Spark Structured Streaming.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.