Time since we first saw it
Day 16
Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
Odesa, UA
Live, first seen by us 16 days agoDesign, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.
Build and optimize Spark pipelines on Microsoft Fabric or Databricks.
Build and optimize Spark pipelines on Microsoft Fabric or Databricks
Diagnose Spark performance using Spark UI and Delta statistics
Manage Delta Lake design, Fabric capacity use, and compute sizing
Create reusable Python libraries and Spark modules for pipelines
Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.
Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
Build and optimize Spark pipelines on Microsoft Fabric or Databricks
Diagnose performance using Spark UI and Delta statistics
Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability
Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization
Our client is expanding its data platform team as part of its ongoing data modernization initiatives.
In the employer’s words · Read in context
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 16
Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
386 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization. Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
· Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation · Production Python library development, packaging, validation, logging, testing, versioning, and documentation · Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness
Must Have · Microsoft Fabric or Databricks production engineering · Apache Spark and Spark UI troubleshooting
Role Overview Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads. Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
· Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown · Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE · Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
· Microsoft Fabric or Databricks production engineering · Apache Spark and Spark UI troubleshooting · Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown
Complete your application on careers.capgemini.com. The employer’s form will show what is required.
Already applied? Track this application
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Resources must be able to provide overlap with the customer's US Eastern Time working hours, including availability through approximately 4:30 PM ET.
Our client is expanding its data platform team as part of its ongoing data modernization initiatives. They are looking to add two hands-on Data Engineers to support the evolution of the Microsoft-based analytics and data platform.
Design, optimize, and operate reliable, large-scale, cost-aware Spark and Delta Lake workloads.
Build and optimize Spark pipelines on Microsoft Fabric or Databricks. Diagnose performance using Spark UI and Delta statistics. Manage Delta Lake design, Fabric capacity consumption, compute sizing, throttling exposure, and operational reliability. Create reusable Python libraries and Spark modules for ingestion, governance, security, monitoring, and optimization.
Demonstrated production troubleshooting and capacity-economics experience, not only notebook or ETL development.
Measures workload behavior before changing infrastructure; optimizes code and configuration before increasing compute; documents pool sizing, throttling risk, and operational requirements; explains capacity behavior to platform and engineering teams.
· Microsoft Fabric or Databricks production engineering
· Apache Spark and Spark UI troubleshooting
· Shuffle skew, spill, OOM, task-duration analysis, AQE, join strategy, and predicate pushdown
· Delta Lake optimization: liquid clustering, partitioning, Z-order, file sizing, OPTIMIZE, statistics, VACUUM, and incremental MERGE
· Fabric capacity economics: CU-seconds, bursting, smoothing, throttling stages, pool configuration, node sizing, concurrency, and workload isolation
· Production Python library development, packaging, validation, logging, testing, versioning, and documentation
· Operational pipeline design: idempotency, watermarks, quarantine, monitoring, failure recovery, and SLA awareness
· OneLake security and access roles
· Governance metadata and TBLPROPERTIES
· Reusable ingestion and maintenance frameworks
· Secrets handling and thread safety
· Direct Lake optimization awareness
We care about all our employees and want them to feel as comfortable as possible. That's why we offer them health insurance from the first days, regardless of the probationary period.
The gift from the company - Christmas holidays from 25 December to 31 December.
Сooperation with Superhumans center and Veteran HUB. Capgemini Engineering has supported the launch of psychological rehabilitation department of Superhumans. Our team also donated over UAH 500 000 prosthetics for three Ukrainian defenders. Currently, we support psychological counseling provided by the Veteran Hub, and we have implemented an internal policy making the company friendly to military and veterans with the assistance of the Hub.
Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Odesa, UA
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.