Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
Medellín, Antioquia, Colombia; Quito, Pichincha, Ecuador
Actively hiring, first seen by us 3 days agoWe're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers.
Build and maintain Spark pipelines over large Parquet datasets on S3
Implement tokenization workflows and dataset intersection and join logic
Deliver healthcare claims datasets for matched individuals with accurate identity mapping
Orchestrate data pipelines with Airflow and AWS-native tools
Optimize Spark jobs, S3 partition layout and Athena query cost and speed
We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS.
Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.
Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity.
Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate.
Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns.
5+ years of professional experience in Data Engineering.
Experience with dbt (core, tests, documentation, exposures).
Excellent communication skills.
Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
Familiarity with healthcare data (claims data, eligibility, member-level datasets).
Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)
From the employer’s posting.
Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices.
In the employer’s words · Read in context
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
4 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- 5+ years of professional experience in Data Engineering. - Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning. - Strong hands-on experience with the AWS data stack, including:
- Amazon S3 (Parquet datasets, partition strategies, data layout best practices) - Amazon Athena (SQL, query optimization, managing large datasets) - Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)
- Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills). - Excellent SQL skills and solid data modeling fundamentals. - Advanced English level: able to lead technical discussions, write clear documentation, and work directly with US-based stakeholders.
About the Role We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS. What You’ll Do
- Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity. - Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate. - Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing).
- Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning. - Strong hands-on experience with the AWS data stack, including: - Amazon S3 (Parquet datasets, partition strategies, data layout best practices)
- Amazon Athena (SQL, query optimization, managing large datasets) - Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus) - Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills).
- Experience with tokenization, identity resolution, or privacy-preserving data workflows. - Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling. - Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures.
- Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling. - Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures. Tech Stack
Tech Stack - AWS-native architecture - Amazon S3 + Parquet (core storage layer)
- Amazon Athena (query engine) - Apache Spark (no Databricks) - Airflow (orchestration)
- Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns. - Contribute to dbt models when applicable (transformations, documentation, data quality checks). - Collaborate with cross-functional stakeholders in a healthcare environment, with a strong focus on privacy and secure data handling.
Nice to Have - Experience with dbt (core, tests, documentation, exposures). - Familiarity with healthcare data (claims data, eligibility, member-level datasets).
- Airflow (orchestration) - dbt (optional, as applicable) Soft Skills
What You’ll Do - Build and maintain Spark pipelines to process large-scale Parquet datasets on S3. - Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.
- Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing). - Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns. - Contribute to dbt models when applicable (transformations, documentation, data quality checks).
- Strong hands-on experience with the AWS data stack, including: - Amazon S3 (Parquet datasets, partition strategies, data layout best practices) - Amazon Athena (SQL, query optimization, managing large datasets)
- AWS-native architecture - Amazon S3 + Parquet (core storage layer) - Amazon Athena (query engine)
- Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus) - Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills). - Excellent SQL skills and solid data modeling fundamentals.
- Apache Spark (no Databricks) - Airflow (orchestration) - dbt (optional, as applicable)
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.
We're looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You'll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you'll be doing "real" data engineering directly on AWS.
Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.
Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity.
Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate.
Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing).
Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns.
Contribute to dbt models when applicable (transformations, documentation, data quality checks).
Collaborate with cross-functional stakeholders in a healthcare environment, with a strong focus on privacy and secure data handling.
5+ years of professional experience in Data Engineering.
Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
Strong hands-on experience with the AWS data stack, including:
Amazon S3 (Parquet datasets, partition strategies, data layout best practices)
Amazon Athena (SQL, query optimization, managing large datasets)
Familiarity with AWS-native data lake patterns (Glue Catalog, Lake Formation concepts are a plus)
Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills).
Excellent SQL skills and solid data modeling fundamentals.
Advanced English level: able to lead technical discussions, write clear documentation, and work directly with US-based stakeholders.
Experience with dbt (core, tests, documentation, exposures).
Familiarity with healthcare data (claims data, eligibility, member-level datasets).
Experience with tokenization, identity resolution, or privacy-preserving data workflows.
Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling.
Experience running Spark on AWS (e.g., EMR) or Spark-on-containers architectures.
AWS-native architecture
Amazon S3 + Parquet (core storage layer)
Amazon Athena (query engine)
Apache Spark (no Databricks)
Airflow (orchestration)
dbt (optional, as applicable)
Strong and empathetic leadership.
Proven client-facing experience.
Excellent communication skills.
Strong expectation management abilities.
Strategic mindset with a solution-oriented approach and strong decision-making skills.
✔ Permanent contract
✔ Learning and continuous growth environment 🚀
✔ Benefits package focused on health and well-being 🎉
✔ Competitive salary based on experience 💰
📍 Apply only if you reside in Ecuador or Colombia📍
At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.
If you meet the profile — or know someone who might be interested — apply now!
We’d love to meet you 💬
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Medellín, Antioquia, Colombia; Quito, Pichincha, Ecuador
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.