Time since we first saw it
Day 2
Early. Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
Katowice, PL
Actively hiring, first seen by us 2 days agoBuild and optimize Spark pipelines on Microsoft Fabric or Databricks
Diagnose performance using Spark UI and Delta statistics
Manage Delta Lake design, Fabric capacity consumption and compute sizing
Create reusable Python libraries and Spark modules for ingestion, governance and monitoring
Measure workload behavior before changing infrastructure, and document pool sizing and throttling risk
Build and optimize Spark pipelines on Microsoft Fabric or Databricks
Diagnose performance using Spark UI and Delta statistics
Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability
Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization
Measures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements
We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow.
In the employer’s words · Read in context
Actively hiringFirst seen by us 2 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 2
Early. Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
386 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. - Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization. - Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
- Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation - Production Python library development, packaging, validation, logging, testing, versioning, and documentation - Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness
Your profile - Microsoft Fabric or Databricks production engineering - Apache Spark and Spark UI troubleshooting
Your tasks - Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. - Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
- Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown - Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE - Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
- Microsoft Fabric or Databricks production engineering - Apache Spark and Spark UI troubleshooting - Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown
Complete your application on careers.capgemini.com. The employer’s form will show what is required.
Already applied? Track this application
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
Our client is expanding its data platform team as part of its ongoing data modernization initiatives. They are looking to add Data Engineer to support the evolution of the Microsoft-based analytics and data platform.
Empoloyee will need to be able to provide overlap with the customer's US Eastern Time working hours, including availability through approximately 4:30 PM ET.
Capgemini is committed to diversity and inclusion, ensuring fairness in all employment practices. We evaluate individuals based on qualifications and performance, not personal characteristics, striving to create a workplace where everyone can succeed and feel valued.
Do you want to get to know us better? Check our Instagram — @capgeminipl or visit our Facebook profile — Capgemini Polska. You can also find us on YouTube.
Capgemini is the business transformation partner for enterprises in the age of AI. We help organizations imagine and build an intelligent, sustainable future, combining AI, technology and human ingenuity to transform how they operate, innovate and grow. With unique end-to-end capabilities spanning strategy, technology, engineering and intelligent operations, we bring together deep industry expertise and market-leading capabilities in AI, cloud and data to turn ambition into measurable business outcomes at scale. Supported by a robust ecosystem of partners and nearly 60 years of expertise, Capgemini is a responsible and diverse global organization of over 410,000 team members in more than 50 countries. The Group reported 2025 revenues of €22.5 billion.
Make it real | www.capgemini.com
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Katowice, PL
- Continuous feedback and ongoing performance discussions thanks to our performance management tool GetSuccess supported by a transparent performance management policy. - Enjoy hybrid working modelonboarding that fits your life - after completing , connect work from a modern office with ergonomic work from home, thanks to home office package (including laptop, monitor, and chair). Ask your recruiter about the details. Get to know us
No clear work-authorization passage found. Eligibility is unconfirmed.