Back to jobs

Lead Data Software Engineer (Databricks)

Pay
Pay not listed
Work setting
Remote — work setting source
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • Architect and implement scalable data pipelines for ingestion and transformation

  • Develop, test, and maintain Python-based data workflows in Databricks

  • Monitor pipeline performance and troubleshoot data processing issues

  • Integrate data workflows into broader systems with software engineering teams

  • Share data insights and pipeline status updates with business stakeholders

From the employer’s posting
Architect and implement scalable data pipelines to support diverse data ingestion and transformation needs
Develop, test, and maintain Python-based data workflows within the Databricks platform
Monitor pipeline performance and troubleshoot data processing issues to maintain data quality and reliability
Collaborate with software engineering teams to ensure smooth integration of data workflows into broader systems
Share data insights and pipeline status updates with business stakeholders to inform decision-making

What you’ll bring

All qualifications

Core experience

  • Proficient in designing and optimizing scalable data workflows using Databricks and Python
  • Skilled in resolving complex data integration challenges across heterogeneous data sources
  • Experience collaborating with software engineers and project managers
  • Can translate business requirements into technical data solutions and pipeline architectures
  • Able to analyse data and communicate findings to stakeholders
Qualification wording
Proficient in designing and optimizing scalable data workflows using Databricks and Python
Skilled in resolving complex data integration challenges across heterogeneous data sources
Experienced in collaborating with cross-functional teams including software engineers and project managers
Capable of translating business requirements into technical data solutions and pipeline architectures
Adept at analysing data to extract meaningful insights and communicating findings to stakeholders

Tools in this posting

  • Python
  • Databricks
Source — Tool mentions in context
What makes a number trustworthy enough to drive decisions across an enterprise? The Senior Data Software Engineer (Databricks) role in Malaga sits at the intersection of data engineering and analytics, where robust pipelines support seamless integration and actionable insights for multiple business units. Working closely with a team of data engineers and software developers, you shape the flow of information that powers business strategy. The challenge is to build infrastructure that adapts as business needs evolve. The person in this role decides how data becomes a reliable asset for the company. Responsibilities Architect and implement scalable data pipelines to support diverse data ingestion and transformation needs Collaborate with software engineering teams to ensure smooth integration of data workflows into broader systems Engage regularly with project managers to align pipeline development with project timelines and objectives Develop, test, and maintain Python-based data workflows within the Databricks platform Monitor pipeline performance and troubleshoot data processing issues to maintain data quality and reliability Share data insights and pipeline status updates with business stakeholders to inform decision-making Participate in planning sessions to design future-proof data infrastructure and integration strategies Requirements Proficient in designing and optimizing scalable data workflows using Databricks and Python Skilled in resolving complex data integration challenges across heterogeneous data sources Experienced in collaborating with cross-functional teams including software engineers and project managers Capable of translating business requirements into technical data solutions and pipeline architectures Adept at analysing data to extract meaningful insights and communicating findings to stakeholders
Check the employer’s page ↗

Posting record

Report an error

Actively hiringFirst seen by us 12 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 9, 202612 days ago
Recorded sightings
13
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 12

Similar jobs usually come down between day 6 and day 56.

From 14,771 similar postings that came down. Coming down is not always a hire.

EPAM Systems is hiring

892 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

Your next step

Check the employer’s posting for the current role and application details.

Already applied? Track this application

Job description

View original posting ↗

What makes a number trustworthy enough to drive decisions across an enterprise? The Senior Data Software Engineer (Databricks) role in Malaga sits at the intersection of data engineering and analytics, where robust pipelines support seamless integration and actionable insights for multiple business units. Working closely with a team of data engineers and software developers, you shape the flow of information that powers business strategy. The challenge is to build infrastructure that adapts as business needs evolve. The person in this role decides how data becomes a reliable asset for the company. Responsibilities Architect and implement scalable data pipelines to support diverse data ingestion and transformation needs Collaborate with software engineering teams to ensure smooth integration of data workflows into broader systems Engage regularly with project managers to align pipeline development with project timelines and objectives Develop, test, and maintain Python-based data workflows within the Databricks platform Monitor pipeline performance and troubleshoot data processing issues to maintain data quality and reliability Share data insights and pipeline status updates with business stakeholders to inform decision-making Participate in planning sessions to design future-proof data infrastructure and integration strategies Requirements Proficient in designing and optimizing scalable data workflows using Databricks and Python Skilled in resolving complex data integration challenges across heterogeneous data sources Experienced in collaborating with cross-functional teams including software engineers and project managers Capable of translating business requirements into technical data solutions and pipeline architectures Adept at analysing data to extract meaningful insights and communicating findings to stakeholders

About EPAM Systems

People
About 3,012 in 2024.Benefit plan filings (Form 5500)
Company
Listed as EPAM.
H-1B visas
21 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Spain

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

AI answers unavailable

We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting