Back to jobs

Lead - Data Engineer

Monterey Park, California, 1600 Corporate Center Dr., Monterey Park, CA 91754

Live, first seen by us 18 days ago
Pay
$170,000–240,000/year · Total compensationAnnual period assumed. Location-specific pay — pay source
This position is remotely based in the U.S. The total compensation target pay range for this role is: $170,000 - $240,000. Actual compensation will be determined based on geographic location (current or future), experience, and other job-related factors. Astrana Health is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. All employment is decided based on qualifications, merit, and business need. If you require assistance in applying for open positions due to a disability, please email us at humanresourcesdept@astranahealth.com to request an accommodation.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type Full Time
Employment type in the employer’s posting: full_time
From the employer’s posting

What you’ll work on

Full posting
  • Build and maintain batch and incremental data pipelines in Databricks, Spark and Delta Lake

  • Design unified healthcare data models covering membership, providers, claims and encounters

  • Implement data governance and access controls through Unity Catalog

  • Establish automated data quality checks, reconciliation and freshness alerting

  • Own incident resolution and root-cause analysis for pipeline failures

From the employer’s posting
Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake.
Design and maintain unified healthcare data models spanning membership, providers, claims, encounters, clinical data, and other business domains.
Implement data governance and access controls through Unity Catalog and established organizational standards
Establish automated data quality checks, source-to-target reconciliation, freshness monitoring, and alerting
Own the investigation and resolution of platform incidents and pipeline failures; perform root-cause analysis

What you’ll bring

All qualifications

Preferred experience

  • Experience administering and optimizing Databricks environments, including Unity Catalog.
  • Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data.
  • Familiarity with healthcare interoperability standards such as HL7, FHIR, and X12.
  • Experience with Terraform or other infrastructure-as-code tools.
Qualification wording
Experience administering and optimizing Databricks environments, including Unity Catalog.
Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data.
Familiarity with healthcare interoperability standards such as HL7, FHIR, and X12.
Experience with Terraform or other infrastructure-as-code tools.
Education & alternatives
Skills, Knowledge & Expertise - Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field. - 5+ years of data engineering experience building and supporting enterprise data platforms and pipelines.
Apply at Astrana Health

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 21, 202618 days ago
Recorded sightings
24
Last seen by us
Nov 7, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$190K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,160 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 18

Similar jobs usually come down between day 6 and day 54.

From 11,511 similar postings that came down. Coming down is not always a hire.

Astrana Health is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Azure
  • Databricks
  • Delta Lake
  • PostgreSQL
  • Spark
  • Terraform
  • PySpark
Where the posting names them
- 3+ years of hands-on experience with Databricks in production environments. - Strong proficiency in Python, PySpark, SQL, and Apache Spark. - Experience with Delta Lake and modern lakehouse architectures.
- Lead the design, development, and delivery of core platform components, including the Constellation Lakehouse in Databricks, Connect API (GraphQL) layer, and Lakebase-backed applications. - Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake. - Integrate data from transactional databases, APIs, files, and external partners into governed datasets that support analytics and operational applications.
- Apply DevOps practices, including Git, automated testing, CI/CD, infrastructure as code, and repeatable deployment across development, testing, and production environments. - Tune pipelines, Spark workloads, SQL queries, and compute configurations to improve performance, scalability, and cost efficiency. - Own the investigation and resolution of platform incidents and pipeline failures; perform root-cause analysis and implement preventive improvements.
- Experience with cloud data platform migrations and modernization initiatives. - Azure, Databricks, or AWS certifications preferred. Job Benefits
We are seeking a Lead - Data Engineer to lead the hands-on design, development, and operation of key components of Astrana’s enterprise data platform, including the Constellation Lakehouse, Connect API (GraphQL) layer, and Lakebase-backed applications. This role will build scalable data pipelines, integrate healthcare data sources, and develop unified data models that support analytics, reporting, AI and machine learning, and operational applications. The position combines advanced data engineering with responsibility for platform reliability, performance, security, and automation within an Azure Databricks environment. As a hands-on technical lead, you will translate complex requirements into reliable production solutions, establish engineering standards, and mentor other engineers. You will collaborate with analytics, software engineering, infrastructure, security, business stakeholders, and external vendors to advance the platform and support its growing adoption.
- Experience with Delta Lake and modern lakehouse architectures. - Hands-on experience with Azure data services and cloud-based data platforms. - Strong knowledge of data modeling, relational databases, and ETL/ELT best practices.
What You'll Do - Lead the design, development, and delivery of core platform components, including the Constellation Lakehouse in Databricks, Connect API (GraphQL) layer, and Lakebase-backed applications. - Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake.
- Develop and support Lakebase-backed applications and PostgreSQL data structures, including integration with lakehouse datasets and application services. - Maintain and optimize Databricks workspaces, compute resources, job orchestration, and environment configurations in collaboration with infrastructure and security teams. - Implement data governance and access controls through Unity Catalog and established organizational standards, including permissions, lineage, and auditability.
- 5+ years of data engineering experience building and supporting enterprise data platforms and pipelines. - 3+ years of hands-on experience with Databricks in production environments. - Strong proficiency in Python, PySpark, SQL, and Apache Spark.
Preferred Qualifications - Experience administering and optimizing Databricks environments, including Unity Catalog. - Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data.
- Strong proficiency in Python, PySpark, SQL, and Apache Spark. - Experience with Delta Lake and modern lakehouse architectures. - Hands-on experience with Azure data services and cloud-based data platforms.
- Build and optimize data access layers and APIs in partnership with software engineering teams, supporting consistent business definitions and reliable downstream consumption. - Develop and support Lakebase-backed applications and PostgreSQL data structures, including integration with lakehouse datasets and application services. - Maintain and optimize Databricks workspaces, compute resources, job orchestration, and environment configurations in collaboration with infrastructure and security teams.
- Experience administering and optimizing Databricks environments, including Unity Catalog. - Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data. - Healthcare data experience, including claims, eligibility, provider, or clinical datasets.
- Familiarity with healthcare interoperability standards such as HL7, FHIR, and X12. - Experience with Terraform or other infrastructure-as-code tools. - Experience with streaming data pipelines and event-driven architectures.

Your next step

Complete your application on careers.astranahealth.com. The employer’s form will show what is required.

Applying through Pinpoint

  • Only .pdf and .docx are accepted. Older .doc files are turned away.

Already applied? Track this application

About Astrana Health

People
About 3,000 in 2025, up 58% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ASTH.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 8% over the last 5 weeks compared with the 5 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of October 26. The fewest in a week was 839, the most 1,314, and the latest week had 1,079.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 5 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Job description

View original posting ↗

We are seeking a Lead - Data Engineer to lead the hands-on design, development, and operation of key components of Astrana’s enterprise data platform, including the Constellation Lakehouse, Connect API (GraphQL) layer, and Lakebase-backed applications.

This role will build scalable data pipelines, integrate healthcare data sources, and develop unified data models that support analytics, reporting, AI and machine learning, and operational applications. The position combines advanced data engineering with responsibility for platform reliability, performance, security, and automation within an Azure Databricks environment.

As a hands-on technical lead, you will translate complex requirements into reliable production solutions, establish engineering standards, and mentor other engineers. You will collaborate with analytics, software engineering, infrastructure, security, business stakeholders, and external vendors to advance the platform and support its growing adoption.

Our Values
  • Put Patients First
  • Empower Entrepreneurial Provider and Care Teams
  • Operate with Integrity & Excellence
  • Be Innovative
  • Work As One Team

What You'll Do

  • Lead the design, development, and delivery of core platform components, including the Constellation Lakehouse in Databricks, Connect API (GraphQL) layer, and Lakebase-backed applications.
  • Build and maintain scalable batch and incremental data pipelines using Databricks, Apache Spark, PySpark, SQL, and Delta Lake.
  • Integrate data from transactional databases, APIs, files, and external partners into governed datasets that support analytics and operational applications.
  • Design and maintain unified healthcare data models spanning membership, providers, claims, encounters, clinical data, and other business domains.
  • Develop reliable ingestion and transformation processes, including change data capture, schema evolution, deduplication, historical tracking, and reconciliation.
  • Build and optimize data access layers and APIs in partnership with software engineering teams, supporting consistent business definitions and reliable downstream consumption.
  • Develop and support Lakebase-backed applications and PostgreSQL data structures, including integration with lakehouse datasets and application services.
  • Maintain and optimize Databricks workspaces, compute resources, job orchestration, and environment configurations in collaboration with infrastructure and security teams.
  • Implement data governance and access controls through Unity Catalog and established organizational standards, including permissions, lineage, and auditability.
  • Establish automated data quality checks, source-to-target reconciliation, freshness monitoring, and alerting to ensure datasets are accurate, complete, and usable.
  • Apply DevOps practices, including Git, automated testing, CI/CD, infrastructure as code, and repeatable deployment across development, testing, and production environments.
  • Tune pipelines, Spark workloads, SQL queries, and compute configurations to improve performance, scalability, and cost efficiency.
  • Own the investigation and resolution of platform incidents and pipeline failures; perform root-cause analysis and implement preventive improvements.
  • Partner with infrastructure teams on backup, recovery, and business continuity procedures, and maintain operational documentation and runbooks.
  • Conduct code and design reviews, establish engineering standards, and mentor engineers across internal and vendor teams.

Skills, Knowledge & Expertise

  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
  • 5+ years of data engineering experience building and supporting enterprise data platforms and pipelines.
  • 3+ years of hands-on experience with Databricks in production environments.
  • Strong proficiency in Python, PySpark, SQL, and Apache Spark.
  • Experience with Delta Lake and modern lakehouse architectures.
  • Hands-on experience with Azure data services and cloud-based data platforms.
  • Strong knowledge of data modeling, relational databases, and ETL/ELT best practices.
  • Experience integrating enterprise databases and APIs into scalable data solutions.
  • Experience with Git, CI/CD pipelines, and automated deployment practices.
  • Proven ability to monitor, troubleshoot, and optimize data pipelines and platform performance.
  • Demonstrated leadership in solution design, code reviews, mentoring, and cross-functional collaboration.
  • Strong problem-solving and communication skills.

Preferred Qualifications

  • Experience administering and optimizing Databricks environments, including Unity Catalog.
  • Experience with PostgreSQL, GraphQL APIs, and operational applications leveraging lakehouse data.
  • Healthcare data experience, including claims, eligibility, provider, or clinical datasets.
  • Familiarity with healthcare interoperability standards such as HL7, FHIR, and X12.
  • Experience with Terraform or other infrastructure-as-code tools.
  • Experience with streaming data pipelines and event-driven architectures.
  • Experience supporting AI, machine learning, or NLP data workloads.
  • Familiarity with regulated data environments and governance best practices.
  • Experience with cloud data platform migrations and modernization initiatives.
  • Azure, Databricks, or AWS certifications preferred.

Job Benefits

  • This position is remotely based in the U.S.
  • The total compensation target pay range for this role is: $170,000 - $240,000. Actual compensation will be determined based on geographic location (current or future), experience, and other job-related factors.
Astrana Health is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. All employment is decided based on qualifications, merit, and business need. If you require assistance in applying for open positions due to a disability, please email us at humanresourcesdept@astranahealth.com to request an accommodation.
 
Additional Information:
The job description does not constitute an employment agreement between the employer and employee and is subject to change by the employer as the needs of the employer and requirements of the job change.

Employment type

Full Time

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
This position is remotely based in the U.S. The total compensation target pay range for this role is: $170,000 - $240,000. Actual compensation will be determined based on geographic location (current or future), experience, and other job-related factors. Astrana Health is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. All employment is decided based on qualifications, merit, and business need. If you require assistance in applying for open positions due to a disability, please email us at humanresourcesdept@astranahealth.com to request an accommodation.
Location & working pattern

Monterey Park, California, 1600 Corporate Center Dr., Monterey Park, CA 91754

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.