Time since we first saw it
Day 16
Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
Cairo, EG
Live, first seen by us 16 days agoDesign, develop, test and maintain batch and streaming PySpark data pipelines
Build and optimize ETL/ELT processes for large-volume enterprise data
Implement data quality controls, reconciliation checks and monitoring
Performance-tune PySpark jobs, Spark configurations, SQL and Hive/Impala workloads
Develop and run Spark workloads within the Cloudera Data Platform
Design, develop, test and maintain scalable batch and streaming data pipelines using PySpark.
Build and optimize ETL/ELT processes for large-volume enterprise data workloads.
Implement data quality controls, reconciliation checks, monitoring and operational logging.
Performance-tune PySpark jobs, Spark configurations, SQL queries and Hive/Impala workloads.
Develop and run Spark workloads within the Cloudera Data Platform (CDP) environment.
At least 4 years of professional experience in data engineering.
At least 3 years of hands-on PySpark / Apache Spark development experience.
Advanced SQL and query optimization
Python
Bachelor's degree in Computer Science, Information Systems, Engineering or a related discipline.
Education & Experience Bachelor's degree in Computer Science, Information Systems, Engineering or a related discipline. At least 4 years of professional experience in data engineering.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 16
Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
386 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Mandatory Technical Skills ✓ PySpark ✓ Apache Spark ✓ Python ✓ Advanced SQL and query optimization ✓ ETL/ELT development ✓ Data warehousing concepts ✓ Linux ✓ Git ✓ Data modeling fundamentals ✓ Experience working with large-scale enterprise data platforms Preferred / Upskillable Skills
Configure, execute, monitor and troubleshoot Spark workloads. Performance-tune PySpark jobs, Spark configurations, SQL queries and Hive/Impala workloads. Diagnose platform, ingestion, transformation, storage and workload execution issues.
Oracle and Teradata Azure data services DevOps and CI/CD pipelines
We are seeking a highly skilled and motivated Senior Data Engineer to join our Data & Analytics practice. The successful candidate will build and operate enterprise-scale data solutions using PySpark, Apache Spark and modern data engineering technologies, with a strong grounding in data warehousing, lakehouse architecture and large-scale data integration. The target environment uses Cloudera Data Platform (CDP). Prior Cloudera experience is preferred but is not a mandatory requirement. Candidates with strong PySpark/Spark expertise and relevant experience on comparable enterprise data platforms will be considered, and Cloudera CDP upskilling will be provided to the selected candidate. This role requires hands-on engineering capability, technical ownership and effective collaboration with architects, analysts, source-system teams and client stakeholders. Experience in banking and financial services is highly desirable.
This role requires hands-on engineering capability, technical ownership and effective collaboration with architects, analysts, source-system teams and client stakeholders. Experience in banking and financial services is highly desirable. Critical hiring priority: Strong, production-grade PySpark/Spark engineering skills and the ability to rapidly learn and work effectively within the Cloudera CDP environment. Key Responsibilities
Apply Spark performance optimization techniques including partitioning, join optimization, caching and handling data skew. Cloudera Platform Engineering Develop and run Spark workloads within the Cloudera Data Platform (CDP) environment.
Cloudera Platform Engineering Develop and run Spark workloads within the Cloudera Data Platform (CDP) environment. Work with components including Cloudera Data Engineering (CDE), Cloudera Data Warehouse (CDW), Hive, Impala, Ozone, Ranger, Atlas and NiFi.
Develop and run Spark workloads within the Cloudera Data Platform (CDP) environment. Work with components including Cloudera Data Engineering (CDE), Cloudera Data Warehouse (CDW), Hive, Impala, Ozone, Ranger, Atlas and NiFi. Configure, execute, monitor and troubleshoot Spark workloads.
Apply security, access-control, metadata and lineage practices using Ranger and Atlas. Candidates without prior Cloudera experience will be expected to complete the required Cloudera enablement/upskilling and apply their existing Spark and data engineering knowledge to the platform. Architecture, Governance & Delivery
Experience delivering large-scale enterprise data pipelines and ETL/ELT solutions. Cloudera CDP experience is an advantage, but not mandatory. Strong candidates from comparable Spark-based data platforms are encouraged to apply. Mandatory Technical Skills
Preferred / Upskillable Skills Cloudera CDP Cloudera CDE and CDW
Cloudera CDP Cloudera CDE and CDW Hive and Impala
DevOps and CI/CD pipelines Cloudera CDP knowledge is preferred, not mandatory. The selected candidate will be provided with Cloudera enablement/upskilling where required. Preferred Domain Background
Cloudera CDE and CDW Hive and Impala Ranger and Atlas
Architecture, Governance & Delivery Contribute to lakehouse implementations using modern table formats such as Apache Iceberg. Apply engineering standards covering modular design, code quality, testing, version control and CI/CD.
Ranger and Atlas Apache Iceberg Apache NiFi and Kafka
Apache Airflow Denodo and Informatica Oracle and Teradata
Apache Iceberg Apache NiFi and Kafka Apache Airflow
Job Description We are seeking a highly skilled and motivated Senior Data Engineer to join our Data & Analytics practice. The successful candidate will build and operate enterprise-scale data solutions using PySpark, Apache Spark and modern data engineering technologies, with a strong grounding in data warehousing, lakehouse architecture and large-scale data integration. The target environment uses Cloudera Data Platform (CDP). Prior Cloudera experience is preferred but is not a mandatory requirement. Candidates with strong PySpark/Spark expertise and relevant experience on comparable enterprise data platforms will be considered, and Cloudera CDP upskilling will be provided to the selected candidate.
Support dimensional, warehouse, data lake and lakehouse data modeling activities. Apply Spark performance optimization techniques including partitioning, join optimization, caching and handling data skew. Cloudera Platform Engineering
At least 4 years of professional experience in data engineering. At least 3 years of hands-on PySpark / Apache Spark development experience. Experience delivering large-scale enterprise data pipelines and ETL/ELT solutions.
Denodo and Informatica Oracle and Teradata Azure data services
Apache NiFi and Kafka Apache Airflow Denodo and Informatica
Data Engineering & Development Design, develop, test and maintain scalable batch and streaming data pipelines using PySpark. Build and optimize ETL/ELT processes for large-volume enterprise data workloads.
Complete your application on careers.capgemini.com. The employer’s form will show what is required.
Already applied? Track this application
We are seeking a highly skilled and motivated Senior Data Engineer to join our Data & Analytics practice. The successful candidate will build and operate enterprise-scale data solutions using PySpark, Apache Spark and modern data engineering technologies, with a strong grounding in data warehousing, lakehouse architecture and large-scale data integration.
The target environment uses Cloudera Data Platform (CDP). Prior Cloudera experience is preferred but is not a mandatory requirement. Candidates with strong PySpark/Spark expertise and relevant experience on comparable enterprise data platforms will be considered, and Cloudera CDP upskilling will be provided to the selected candidate.
This role requires hands-on engineering capability, technical ownership and effective collaboration with architects, analysts, source-system teams and client stakeholders. Experience in banking and financial services is highly desirable.
Critical hiring priority: Strong, production-grade PySpark/Spark engineering skills and the ability to rapidly learn and work effectively within the Cloudera CDP environment.
Key Responsibilities
Data Engineering & Development
Design, develop, test and maintain scalable batch and streaming data pipelines using PySpark.
Build and optimize ETL/ELT processes for large-volume enterprise data workloads.
Develop reusable ingestion, transformation and validation frameworks.
Implement data quality controls, reconciliation checks, monitoring and operational logging.
Support dimensional, warehouse, data lake and lakehouse data modeling activities.
Apply Spark performance optimization techniques including partitioning, join optimization, caching and handling data skew.
Cloudera Platform Engineering
Develop and run Spark workloads within the Cloudera Data Platform (CDP) environment.
Work with components including Cloudera Data Engineering (CDE), Cloudera Data Warehouse (CDW), Hive, Impala, Ozone, Ranger, Atlas and NiFi.
Configure, execute, monitor and troubleshoot Spark workloads.
Performance-tune PySpark jobs, Spark configurations, SQL queries and Hive/Impala workloads.
Diagnose platform, ingestion, transformation, storage and workload execution issues.
Apply security, access-control, metadata and lineage practices using Ranger and Atlas.
Candidates without prior Cloudera experience will be expected to complete the required Cloudera enablement/upskilling and apply their existing Spark and data engineering knowledge to the platform.
Architecture, Governance & Delivery
Contribute to lakehouse implementations using modern table formats such as Apache Iceberg.
Apply engineering standards covering modular design, code quality, testing, version control and CI/CD.
Participate in requirements analysis, solution design, technical estimation and design reviews.
Support system integration testing, UAT, production deployment and operational readiness.
Produce clear technical documentation and deliver structured knowledge-transfer sessions.
Collaborate effectively with distributed, multicultural teams and technical and business stakeholders.
Candidate Profile
Education & Experience
Bachelor's degree in Computer Science, Information Systems, Engineering or a related discipline.
At least 4 years of professional experience in data engineering.
At least 3 years of hands-on PySpark / Apache Spark development experience.
Experience delivering large-scale enterprise data pipelines and ETL/ELT solutions.
Cloudera CDP experience is an advantage, but not mandatory. Strong candidates from comparable Spark-based data platforms are encouraged to apply.
Mandatory Technical Skills
✓ PySpark
✓ Apache Spark
✓ Python
✓ Advanced SQL and query optimization
✓ ETL/ELT development
✓ Data warehousing concepts
✓ Linux
✓ Git
✓ Data modeling fundamentals
✓ Experience working with large-scale enterprise data platforms
Preferred / Upskillable Skills
Cloudera CDP
Cloudera CDE and CDW
Hive and Impala
Ranger and Atlas
Apache Iceberg
Apache NiFi and Kafka
Apache Airflow
Denodo and Informatica
Oracle and Teradata
Azure data services
DevOps and CI/CD pipelines
Cloudera CDP knowledge is preferred, not mandatory. The selected candidate will be provided with Cloudera enablement/upskilling where required.
Preferred Domain Background
Banking and financial services
Digital banking platforms
Customer analytics
Regulatory reporting
Enterprise data warehousing
Data lakehouse implementation and migration programs
Behavioural Competencies
Strong analytical thinking and structured problem solving.
Ownership mindset with the ability to work independently and deliver reliably.
Clear written and verbal communication with technical and non-technical stakeholders.
Ability to mentor junior engineers and contribute to team capability building.
Ability and willingness to quickly learn new data platforms and technologies.
Comfort working in distributed and multicultural delivery teams.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Cairo, EG
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.