Pay
Higher than most similar jobs
$129K–$231K against $100K–$169K, the middle half of what similar US postings state.
From 163 postings in the last year. Stated ranges, not salaries paid.
Indianapolis, Indiana, United States of America
Live, first seen by us 16 days agoActual compensation will depend on a candidate’s education, experience, skills, and geographic location. The anticipated wage for this position is $129,000 - $231,000 Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.Read the full posting
Define architecture for profile master data, including Reltio match, merge and survivorship logic
Design how consent data from Transcend is enforced across pipelines and profiles
Design how data subject requests like access and deletion are carried out across systems
Lead batch and near-real-time PySpark pipelines on Databricks and AWS
Set coding, code review, and CI/CD standards, and mentor engineers
Define and own the technical architecture for profile master data, including Reltio integration, match and merge logic, survivorship rules
Design how consent and preference data from Transcend flows through the platform
Design how data subject requests (for example access and deletion) are carried out across profile data and downstream systems
Lead design and delivery of batch and near-real-time pipelines in Python and PySpark on Databricks and AWS
Set coding standards, code review practices, and documentation
Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
Hands-on experience with Transcend (or a similar consent platform) for consent, preference, or data subject request workflows.
8+ years of professional experience in data engineering or software engineering, including 3+ years as a tech lead, principal engineer, or senior individual contributor.
Experience with data modeling (dimensional and lakehouse medallion patterns) and data governance, security, and quality practices, including protection of sensitive data (PII/PHI).
3+ years of hands-on experience with Reltio (or a comparable MDM platform) for profile or customer master data, including match rules, survivorship, and integration patterns.
Experience with CI/CD, Git, and infrastructure-as-code (Terraform, CDK, or CloudFormation).
Basic Qualifications: - Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field. - 8+ years of professional experience in data engineering or software engineering, including 3+ years as a tech lead, principal engineer, or senior individual contributor.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Higher than most similar jobs
$129K–$231K against $100K–$169K, the middle half of what similar US postings state.
From 163 postings in the last year. Stated ranges, not salaries paid.
Day 16
Similar jobs usually come down between day 6 and day 52.
At Lilly, jobs usually come down by about day 27.
From 2,081 similar postings that came down, and 101 of Lilly’s. Coming down is not always a hire.
40 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Data engineering delivery - Lead design and delivery of batch and near-real-time pipelines in Python and PySpark on Databricks and AWS. - Design Delta Lake and lakehouse (medallion) structures with sound partitioning, schema evolution, and Unity Catalog governance.
- Hands-on experience with Transcend (or a similar consent platform) for consent, preference, or data subject request workflows. - Expert-level Python and PySpark, with production-grade code, automated testing, and performance tuning, and advanced SQL, including window functions, CTEs, and query optimization. - Strong hands-on experience building data pipelines on AWS (for example S3, Glue, Lambda, Step Functions, Athena or Redshift, IAM) and Databricks, including Delta Lake.
- Set standards for CI/CD and infrastructure-as-code for data workloads, working with the DevOps engineer, so environments are repeatable and reviewed. - Tune SQL, Spark jobs, and data models for performance and cost. - Own production support for data pipelines, including escalation, incident response, and root cause analysis, in partnership with the DevOps engineer.
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us. We are a global healthcare leader headquartered in Indianapolis, Indiana. As Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team, you will own the technical direction and delivery of the data platform that creates trusted, consented customer and partner profiles. You will set engineering standards, guide a team of data engineers, and be the go-to expert on how Reltio (profile master data) and Transcend (consent management) work with our AWS and Databricks data platform. This is a hands-on technical leadership role. Your work ensures the right data, used with the right consent, reaches patients and the business, supporting Lilly's mission to deliver life-changing medicines. What you’ll be doing:
- Expert-level Python and PySpark, with production-grade code, automated testing, and performance tuning, and advanced SQL, including window functions, CTEs, and query optimization. - Strong hands-on experience building data pipelines on AWS (for example S3, Glue, Lambda, Step Functions, Athena or Redshift, IAM) and Databricks, including Delta Lake. - Experience with data modeling (dimensional and lakehouse medallion patterns) and data governance, security, and quality practices, including protection of sensitive data (PII/PHI).
- Familiarity with data quality frameworks (for example Great Expectations or dbt tests) and with streaming platforms (Kafka, Kinesis, or MSK). - Familiarity with data catalog and governance tools such as Unity Catalog or AWS Lake Formation. - AWS Certified Data Engineer - Associate, AWS Solutions Architect, or Databricks Certified Data Engineer (Associate or Professional).
- Familiarity with data catalog and governance tools such as Unity Catalog or AWS Lake Formation. - AWS Certified Data Engineer - Associate, AWS Solutions Architect, or Databricks Certified Data Engineer (Associate or Professional). Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.
- Experience partnering with and influencing vendor resources on solution development and delivery. - Experience with orchestration tools such as Apache Airflow or Databricks Workflows. - Familiarity with data quality frameworks (for example Great Expectations or dbt tests) and with streaming platforms (Kafka, Kinesis, or MSK).
- Experience with orchestration tools such as Apache Airflow or Databricks Workflows. - Familiarity with data quality frameworks (for example Great Expectations or dbt tests) and with streaming platforms (Kafka, Kinesis, or MSK). - Familiarity with data catalog and governance tools such as Unity Catalog or AWS Lake Formation.
- Lead design and delivery of batch and near-real-time pipelines in Python and PySpark on Databricks and AWS. - Design Delta Lake and lakehouse (medallion) structures with sound partitioning, schema evolution, and Unity Catalog governance. - Build observable pipelines with error handling, retries, alerting, and clear SLAs.
- Experience with data modeling (dimensional and lakehouse medallion patterns) and data governance, security, and quality practices, including protection of sensitive data (PII/PHI). - Experience with CI/CD, Git, and infrastructure-as-code (Terraform, CDK, or CloudFormation). - Ability to lead technical design, mentor engineers, and communicate clearly with technical and non-technical stakeholders.
Complete your application on lilly.wd115.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life-changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.
We are a global healthcare leader headquartered in Indianapolis, Indiana. As Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team, you will own the technical direction and delivery of the data platform that creates trusted, consented customer and partner profiles. You will set engineering standards, guide a team of data engineers, and be the go-to expert on how Reltio (profile master data) and Transcend (consent management) work with our AWS and Databricks data platform. This is a hands-on technical leadership role. Your work ensures the right data, used with the right consent, reaches patients and the business, supporting Lilly's mission to deliver life-changing medicines.
What you’ll be doing:
Master data and consent
Data engineering delivery
Technical leadership
How You Will Succeed:
Basic Qualifications:
Additional Skills & Preferences:
Lilly is dedicated to helping individuals with disabilities to actively engage in the workforce, ensuring equal opportunities when vying for positions. If you require accommodation to submit a resume for a position at Lilly, please complete the accommodation request form (https://careers.lilly.com/us/en/workplace-accommodation) for further assistance. Please note this is for individuals to request an accommodation as part of the application process and any other correspondence will not receive a response.
Lilly is proud to be an EEO Employer and does not discriminate on the basis of age, race, color, religion, gender identity, sex, gender expression, sexual orientation, genetic information, ancestry, national origin, protected veteran status, disability, or any other legally protected status.
Our employee resource groups (ERGs) offer strong support networks for their members and are open to all employees. Our current groups include: Africa, Middle East, Central Asia (AMECA), Black Employees at Lilly (BE@Lilly), Chinese Culture Network (CCN), EnAble, Evolve, Lilly Indian Network (LIN), Organization of Latinx at Lilly (OLA), Pride (LGBTQ+ Allies), Veterans Leadership Network (VLN) and Women’s Initiative for Leading at Lilly (WILL).
Actual compensation will depend on a candidate’s education, experience, skills, and geographic location. The anticipated wage for this position is
$129,000 - $231,000Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.
#WeAreLilly
New Data Governance postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Governance, by the work the posting describes.
Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.
Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.
A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Actual compensation will depend on a candidate’s education, experience, skills, and geographic location. The anticipated wage for this position is $129,000 - $231,000 Full-time equivalent employees also will be eligible for a company bonus (depending, in part, on company and individual performance). In addition, Lilly offers a comprehensive benefit program to eligible employees, including eligibility to participate in a company-sponsored 401(k); pension; vacation benefits; eligibility for medical, dental, vision and prescription drug benefits; flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts); life insurance and death benefits; certain time off and leave of absence benefits; and well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities).Lilly reserves the right to amend, modify, or terminate its compensation and benefit programs in its sole discretion and Lilly’s compensation practices and guidelines will apply regarding the details of any promotion or transfer of Lilly employees.
Indianapolis, Indiana, United States of America
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.