Back to jobs

Lead Data Engineer

Pay
Pay not listed
Work setting
Hybrid — work setting source
Travel: 0% Location: IN, Bangalore - Hybrid Work Environment Don’t meet every single requirement? Studies have shown underrecognized groups are less likely to apply to jobs unless they meet every single qualification. At Elanco we are dedicated to building a diverse and inclusive work environment. If you think you might be a good fit for a role but don't necessarily meet every requirement, we encourage you to apply. You may be the right candidate for this role or other roles!
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Design and implement complex end-to-end data pipelines across large SAP datasets

  • Own routine production incidents and deliver permanent fixes with code, tests and docs

  • Mentor junior engineers and act as gatekeeper for technical standards

  • Design data quality checks and make sure tests run in CI/CD schedules

  • Tune pipeline performance and memory use with query plans and Spark UI

From the employer’s posting
Independently design and implement complex end-to-end data pipelines spanning multiple sources and large SAP datasets
Own routine production incidents in familiar pipelines (schema drift, late files, logic errors) and deliver permanent fixes by updating code, tests, and documentation.
Act as the primary gatekeeper for technical standards; ensure junior engineers are proficient in foundational tooling
Design and implement meaningful data quality checks (referential integrity, distribution checks) and ensure tests run in CI/CD schedules.
identify and fix performance or memory issues using query plans and Spark UI without assistance
Education & alternatives
What You Need to Succeed (minimum qualifications): - Bachelor’s degree in computer science, Software Engineering, or equivalent professional experience. - 6+ years of experience engineering and delivering enterprise scale data solutions.
Apply at Elanco

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 8, 202641 days ago
Recorded sightings
85
Last seen by us
Nov 15, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 41

Similar jobs usually come down between day 6 and day 56.

At Elanco, jobs usually come down by about day 21.

From 14,168 similar postings that came down, and 13 of Elanco’s. Coming down is not always a hire.

Elanco is hiring

9 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • BigQuery
  • Databricks
  • Delta Lake
  • SAP
  • Spark
  • PySpark
Where the posting names them
- Proven ability to independently deliver moderately complex data projects within a defined design. - Strong proficiency in SQL (multi-join, window functions), Python, and Spark for building and maintaining data products. - Experience working with modern data architectures, including Lakehouse (Bronze/Silver/Gold), star schemas, and data contracts.
Your Role: Lead Data Engineer Data Engineering at Elanco delivers products and thought leadership that transform how the organization leverages data. The ERP Enterprise Data Product (EEDP) team is a critical pillar of this strategy, responsible for modernizing our complex ERP data landscape. EEDP provides a robust, near real-time replication of SAP S/4HANA data into Google BigQuery, which is then integrated into our Enterprise Lakehouse (Databricks) to power advanced AI/ML, conversational analytics, and global reporting. Your Responsibilities :
- 6+ years of experience engineering and delivering enterprise scale data solutions. - Proven experience with Google BigQuery (BigQuery Studio) and Databricks (PySpark/Delta Lake) is required. - Familiarity with SAP data structures (S/4HANA), SAP BW and experience with replication tools like SAP SLT (System Landscape Transformation Server) is highly preferred.
- Proven experience with Google BigQuery (BigQuery Studio) and Databricks (PySpark/Delta Lake) is required. - Familiarity with SAP data structures (S/4HANA), SAP BW and experience with replication tools like SAP SLT (System Landscape Transformation Server) is highly preferred. - Experience mentoring junior engineers, stewarding a practitioner community, and/or ensuring a team’s adherence to technical standards.

Your next step

Complete your application on elanco.wd5.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

At Elanco (NYSE: ELAN) – it all starts with animals!

As a global leader in animal health, we are dedicated to innovation and delivering products and services to prevent and treat disease in farm animals and pets. At Elanco, we are driven by our vision of Food and Companionship Enriching Life and our purpose – all to Go Beyond for Animals, Customers, Society and Our People.

At Elanco, we pride ourselves on fostering a diverse and inclusive work environment. We believe that diversity is the driving force behind innovation, creativity, and overall business success. Here, you’ll be part of a company that values and champions new ways of thinking, work with dynamic individuals, and acquire new skills and experiences that will propel your career to new heights.

Making animals’ lives better makes life better – join our team today!

Your Role: Lead Data Engineer

 

Data Engineering at Elanco delivers products and thought leadership that transform how the organization leverages data. The ERP Enterprise Data Product (EEDP) team is a critical pillar of this strategy, responsible for modernizing our complex ERP data landscape. EEDP provides a robust, near real-time replication of SAP S/4HANA data into Google BigQuery, which is then integrated into our Enterprise Lakehouse (Databricks) to power advanced AI/ML, conversational analytics, and global reporting.

 

Your Responsibilities : 

  • Complex Pipeline Ownership: Independently design and implement complex end-to-end data pipelines spanning multiple sources and large SAP datasets (Configuration, Master Data, Transactional). Anticipate scaling needs, data skew, and growth using patterns like partitioning, clustering, and incremental backfills.
  • Technical Mentorship: Act as the primary gatekeeper for technical standards; ensure junior engineers are proficient in foundational tooling (e.g., Git branching, environment setup) and consistently apply testing patterns.
  • Production Ownership: Own routine production incidents in familiar pipelines (schema drift, late files, logic errors) and deliver permanent fixes by updating code, tests, and documentation.
  • Stakeholder Collaboration: Work directly with analysts and data scientists to refine requirements into concrete technical stories, proactively surfacing edge cases such as late-arriving data or schema changes.
  • Standards Advocacy: Ensure the adoption of Elanco’s data standards and foundational tools (GitHub, VS Code, SonarQube, Copilot) across the team, using code reviews as a teaching tool.
  • Efficiency & Optimization: Monitor key pipelines using logs and dashboards; identify and fix performance or memory issues using query plans and Spark UI without assistance.
  • Quality Assurance: Design and implement meaningful data quality checks (referential integrity, distribution checks) and ensure tests run in CI/CD schedules.
  • Continuous Improvement: Proactively identify and fix knowledge silos by creating reusable assets and documentation to ensure peers can follow established patterns.
  • Community Contribution: Contribute to the Data Engineering community across Elanco to inspire, engage, and ignite innovation.
  • Learning Mindset: Embrace and demonstrate a growth and sharing mindset, leveraging AI to accelerate intermediate tasks and tackle complex engineering challenges.

 

What You Need to Succeed (minimum qualifications):

  • Bachelor’s degree in computer science, Software Engineering, or equivalent professional experience.
  • 6+ years of experience engineering and delivering enterprise scale data solutions.
  • Proven experience with Google BigQuery (BigQuery Studio) and Databricks (PySpark/Delta Lake) is required.
  • Familiarity with SAP data structures (S/4HANA), SAP BW and experience with replication tools like SAP SLT (System Landscape Transformation Server) is highly preferred.
  • Experience mentoring junior engineers, stewarding a practitioner community, and/or ensuring a team’s adherence to technical standards.

 

What will give you a competitive edge (preferred qualifications):


  • Proven ability to independently deliver moderately complex data projects within a defined design.
  • Strong proficiency in SQL (multi-join, window functions), Python, and Spark for building and maintaining data products.
  • Experience working with modern data architectures, including Lakehouse (Bronze/Silver/Gold), star schemas, and data contracts.
  • Experience working within a DevSecOps culture, including Git, CI/CD, and Test-Driven Development (TDD).
  • Familiarity with data quality frameworks, data governance, and cost/efficiency considerations in cloud environments.
  • Experience working in diverse global landscapes (business, technology, regulatory, and geography).
  • Excellent interpersonal and communication skills; proven ability to turn rough requirements into clear, testable specifications.

 

Additional Information:

  • Travel: 0%
  • Location: IN, Bangalore - Hybrid Work Environment

 

Don’t meet every single requirement? Studies have shown underrecognized groups are less likely to apply to jobs unless they meet every single qualification. At Elanco we are dedicated to building a diverse and inclusive work environment. If you think you might be a good fit for a role but don't necessarily meet every requirement, we encourage you to apply. You may be the right candidate for this role or other roles!

Elanco is an EEO/Affirmative Action Employer and does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status

Elanco may use automated tools, including AI, to support parts of our recruitment process, such as reviewing applications against job‑related criteria and/or transferrable skills. These tools help ensure a consistent, structured evaluation, but they do not make hiring decisions. All decisions involve a human reviewer. For more information on how we handle personal data, please see our Elanco Workforce Privacy Notice.

About Elanco

People
About 9,400 in 2025, up 4% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ELAN.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 860, the most 1,353, and the latest week had 1,020.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

IN - Bangalore

- Travel: 0% - Location: IN, Bangalore - Hybrid Work Environment Don’t meet every single requirement? Studies have shown underrecognized groups are less likely to apply to jobs unless they meet every single qualification. At Elanco we are dedicated to building a diverse and inclusive work environment. If you think you might be a good fit for a role but don't necessarily meet every requirement, we encourage you to apply. You may be the right candidate for this role or other roles!
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.