Back to jobs

189. Senior Data Engineer

Medellín, Antioquia, Colombia; Quito, Pichincha, Ecuador

Actively hiring, first seen by us 3 days ago
Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting

We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers.

  • Build and maintain Spark pipelines over large Parquet datasets on S3

  • Implement tokenization workflows and dataset intersection and join logic

  • Deliver healthcare claims datasets for matched individuals with accurate identity mapping

  • Orchestrate data pipelines with Airflow and AWS-native tools

  • Optimize Spark jobs, S3 partition layout and Athena query cost and speed

From the employer’s posting
We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS.
Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.
Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity.
Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate.
Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns.

What you’ll bring

All qualifications

Core experience

  • 5+ years of professional experience in Data Engineering.
  • Experience with dbt (core, tests, documentation, exposures).
  • Excellent communication skills.
  • Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
  • Familiarity with healthcare data (claims data, eligibility, member-level datasets).
  • Familiarity with AWS-native data lake patterns

Preferred experience

  • Glue Catalog, Lake Formation concepts are a plus
Qualification wording
5+ years of professional experience in Data Engineering.
Experience with dbt (core, tests, documentation, exposures).
Excellent communication skills.
Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
Familiarity with healthcare data (claims data, eligibility, member-level datasets).
Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)

Benefits in the posting

Full benefits wording
  • ✔ Permanent contract ✔ Learning and continuous growth environment 🚀 ✔ Benefits package focused on health and well-being 🎉 ✔ Competitive salary based on experience 💰
  • 📍 Apply only if you reside in Ecuador or Colombia📍
  • At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.

From the employer’s posting.

About Source Meridian

Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices.

In the employer’s words · Read in context

Apply at Source Meridian

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Oct 30, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,771 similar postings that came down. Coming down is not always a hire.

Source Meridian is hiring

4 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Scala
  • SQL
  • AWS
  • Databricks
  • dbt
  • S3
  • Snowflake
  • Spark
  • Airflow
  • PySpark
Where the posting names them
- 5+ years of professional experience in Data Engineering. - Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning. - Strong hands-on experience with the AWS data stack, including:
- Amazon S3 (Parquet datasets, partition strategies, data layout best practices) - Amazon Athena (SQL, query optimization, managing large datasets) - Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)
- Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills). - Excellent SQL skills and solid data modeling fundamentals. - Advanced English level: able to lead technical discussions, write clear documentation, and work directly with US-based stakeholders.
About the Role We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS. What You’ll Do
- Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity. - Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate. - Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing).
- Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning. - Strong hands-on experience with the AWS data stack, including: - Amazon S3 (Parquet datasets, partition strategies, data layout best practices)
- Amazon Athena (SQL, query optimization, managing large datasets) - Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus) - Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills).
- Experience with tokenization, identity resolution, or privacy-preserving data workflows. - Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling. - Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures.
- Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling. - Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures. Tech Stack
Tech Stack - AWS-native architecture - Amazon S3 + Parquet (core storage layer)
- Amazon Athena (query engine) - Apache Spark (no Databricks) - Airflow (orchestration)
- Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns. - Contribute to dbt models when applicable (transformations, documentation, data quality checks). - Collaborate with cross-functional stakeholders in a healthcare environment, with a strong focus on privacy and secure data handling.
Nice to Have - Experience with dbt (core, tests, documentation, exposures). - Familiarity with healthcare data (claims data, eligibility, member-level datasets).
- Airflow (orchestration) - dbt (optional, as applicable) Soft Skills
What You’ll Do - Build and maintain Spark pipelines to process large-scale Parquet datasets on S3. - Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.
- Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing). - Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns. - Contribute to dbt models when applicable (transformations, documentation, data quality checks).
- Strong hands-on experience with the AWS data stack, including: - Amazon S3 (Parquet datasets, partition strategies, data layout best practices) - Amazon Athena (SQL, query optimization, managing large datasets)
- AWS-native architecture - Amazon S3 + Parquet (core storage layer) - Amazon Athena (query engine)
- Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus) - Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills). - Excellent SQL skills and solid data modeling fundamentals.
- Apache Spark (no Databricks) - Airflow (orchestration) - dbt (optional, as applicable)

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

We’re looking for a Senior Data Engineer to join Source Meridian.

About Source Meridian

Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.

About the Role

We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS.

What You’ll Do

  • Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.

  • Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.

  • Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity.

  • Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate.

  • Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing).

  • Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns.

  • Contribute to dbt models when applicable (transformations, documentation, data quality checks).

  • Collaborate with cross-functional stakeholders in a healthcare environment, with a strong focus on privacy and secure data handling.

Required Qualifications

  • 5+ years of professional experience in Data Engineering.

  • Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.

  • Strong hands-on experience with the AWS data stack, including:

    • Amazon S3 (Parquet datasets, partition strategies, data layout best practices)

    • Amazon Athena (SQL, query optimization, managing large datasets)

    • Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)

  • Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills).

  • Excellent SQL skills and solid data modeling fundamentals.

  • Advanced English level: able to lead technical discussions, write clear documentation, and work directly with US-based stakeholders.

Nice to Have

  • Experience with dbt (core, tests, documentation, exposures).

  • Familiarity with healthcare data (claims data, eligibility, member-level datasets).

  • Experience with tokenization, identity resolution, or privacy-preserving data workflows.

  • Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling.

  • Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures.

Tech Stack

  • AWS-native architecture

  • Amazon S3 + Parquet (core storage layer)

  • Amazon Athena (query engine)

  • Apache Spark (no Databricks)

  • Airflow (orchestration)

  • dbt (optional, as applicable)

Soft Skills

  • Strong and empathetic leadership.

  • Proven client-facing experience.

  • Excellent communication skills.

  • Strong expectation management abilities.

  • Strategic mindset with a solution-oriented approach and strong decision-making skills.

What We Offer

✔ Permanent contract
✔ Learning and continuous growth environment 🚀
✔ Benefits package focused on health and well-being 🎉
✔ Competitive salary based on experience 💰

 

📍 Apply only if you reside in Ecuador or Colombia📍

 

At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.

If you meet the profile — or know someone who might be interested — apply now!

We’d love to meet you 💬

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Medellín, Antioquia, Colombia; Quito, Pichincha, Ecuador

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.