Back to jobs

Senior Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Build and optimize Spark pipelines on Microsoft Fabric or Databricks

  • Diagnose performance using Spark UI and Delta statistics

  • Manage Delta Lake design, Fabric capacity consumption and compute sizing

  • Create reusable Python libraries and Spark modules for ingestion, governance and monitoring

  • Measure workload behavior before changing infrastructure, and document pool sizing and throttling risk

From the employer’s posting
Build and optimize Spark pipelines on Microsoft Fabric or Databricks
Diagnose performance using Spark UI and Delta statistics
Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability
Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization
Measures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements

About Capgemini Service SAS

We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow.

In the employer’s words · Read in context

Apply at Capgemini Service SAS

Posting record

Report an error

Actively hiringFirst seen by us 2 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 19, 20262 days ago
Recorded sightings
4
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 2

Early. Similar jobs usually come down between day 6 and day 56.

From 14,767 similar postings that came down. Coming down is not always a hire.

Capgemini Service SAS is hiring

386 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • 1% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Databricks
  • Delta Lake
  • Spark
Where the posting names them
- Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. - Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization. - Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
- Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation - Production Python library development, packaging, validation, logging, testing, versioning, and documentation - Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness
Your profile - Microsoft Fabric or Databricks production engineering - Apache Spark and Spark UI troubleshooting
Your tasks - Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. - Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
- Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown - Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE - Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
- Microsoft Fabric or Databricks production engineering - Apache Spark and Spark UI troubleshooting - Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown

Your next step

Complete your application on careers.capgemini.com. The employer’s form will show what is required.

Applying through SAP SuccessFactors

  • Images (.jpg) aren’t accepted as a resume.

Already applied? Track this application

Job description

View original posting ↗

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Your role

Our client is expanding its data platform team as part of its ongoing data modernization initiatives. They are looking to add  Data Engineer to support the evolution of the Microsoft-based analytics and data platform.

Empoloyee will need to be able to provide overlap with the customer's US Eastern Time working hours, including availability through approximately 4:30 PM ET.

Your tasks

  • Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.
  • Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
  • Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
  • Measures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements; explains capacity behavior to platform and engineering teams.

Your profile

  • Microsoft Fabric or Databricks production engineering
  • Apache Spark and Spark UI troubleshooting
  • Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown
  • Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE
  • Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
  • Production Python library development, packaging, validation, logging, testing, versioning, and documentation
  • Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness

What You'll love about working here

  • Well-being culture: medical care with Medicover, private life insurance, and sports card. But we went one step further by creating our own Capgemini Helpline offering therapeutical support if needed and the educational podcast "Let's talk about wellbeing" which you can listen to on Spotify.
  • Access to over 70 training tracks with certification opportunities (e.g., GenAI, Architects, Google) on our NEXT platform. Dive into a world of knowledge with free access to Education First languages platform, TED Talks and Udemy Business materials and trainings. 
  • Continuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy.
  • Enjoy hybrid working modelonboarding that fits your life - after completing , connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details.

Get to know us

Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.

Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube. 

About Capgemini

Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market-leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.

 

Make it real | www.capgemini.com

About Capgemini Service SAS

People
About 11,267 in 2024.Benefit plan filings (Form 5500)
Company
Listed as CAP.PA.
H-1B visas
771 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Katowice, PL

- Continuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy. - Enjoy hybrid working modelonboarding that fits your life - after completing , connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details. Get to know us
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.