Time since we first saw it
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 14,159 similar postings that came down. Coming down is not always a hire.
Pune, Maharashtra, India
Actively hiring, first seen by us 18 hours agoEmployment type in the employer’s posting: Full-timeFrom the employer’s posting
Design, build and manage end-to-end data pipelines across the medallion architecture
Ingest and process raw data with Spark and Amazon EMR
Develop and automate base vault transformations in DBT
Design, build, and manage end-to-end data pipelines across the medallion architecture
Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
Develop and automate data transformations for the base vault using DBT
At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack
Deep experience with Spark, Python and ETLs and Amazon EMR (Must)
Hands-on experience with DBT for data transformation and modeling.
From the employer’s posting.
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
In the employer’s words · Read in context
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 14,159 similar postings that came down. Coming down is not always a hire.
40 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge) - Java Spring Boot - IBM ACE Programming
- Elasticsearch - cluster optimization, query development, data modeling, performance tuning & administration (4-6 Years) (Must) - Deep experience with Spark, Python and ETLs and Amazon EMR (Must) - Hands-on experience with DBT for data transformation and modeling.
- IBM ACE Programming - BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar - Full English Fluency
- Hands-on experience with DBT for data transformation and modeling. - Apache Airflow, AWS Step Functions, or similar. (Must) - Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management.
- Experience with Dremio, Looker, or equivalent business view/semantic layer technologies - AWS Cloud – Intermediate, AWS Lambda (Must) , Step Functions, IAM, SNS, API Gateway, VPC, Transit Gateway, Intermediate (3-4 Years) - JSON - Intermediate (4-6 Years)
Role Responsibilities: • Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers. • Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
• Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation. • Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently. Requirements
- Deep experience with Spark, Python and ETLs and Amazon EMR (Must) - Hands-on experience with DBT for data transformation and modeling. - Apache Airflow, AWS Step Functions, or similar. (Must)
Requirements - At least 5 years of experience as an Elasticsearch Data Engineer - ELK (Elasticsearch, Logstash, and Kibana) stack Expert knowledge) - Java Spring Boot
Software / Tool Skills - Elasticsearch - cluster optimization, query development, data modeling, performance tuning & administration (4-6 Years) (Must) - Deep experience with Spark, Python and ETLs and Amazon EMR (Must)
- Apache Airflow, AWS Step Functions, or similar. (Must) - Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management. - Experience with Kubernetes for container orchestration.
- Expert knowledge of Amazon S3 and Apache Iceberg for data storage and management. - Experience with Kubernetes for container orchestration. - Experience with Dremio, Looker, or equivalent business view/semantic layer technologies
• Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers. • Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation. • Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
Our Client is one of the United States’ largest insurers, providing a wide range of insurance and financial services products with gross written premiums well over US$25 Billion (P&C). They proudly serve more than 10 million U.S. households with more than 19 million individual policies across all 50 states through the efforts of over 48,000 exclusive and independent agents and nearly 18,500 employees. Finally, our Client is part of one the largest Insurance Groups in the world.
The Data Engineer will architect, develop, and maintain scalable data pipelines within a medallion architecture (bronze, silver/base vault, business vault, gold layers). This role is key in enabling high-quality, business-ready datasets by leveraging modern data engineering technologies and orchestration practices.
Role Responsibilities:
• Design, build, and manage end-to-end data pipelines across the medallion architecture—specifically the bronze, silver (base vault with DBT and orchestration tools, business vault), and gold layers.
• Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
• Develop and automate data transformations for the base vault using DBT (Data Build Tool) to standardize and model data efficiently.
Requirements
Skills & Competencies
Software / Tool Skills
Benefits
This position comes with competitive compensation and benefits package:
About Capgemini
Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 340,000 team members in more than 50 countries. With its strong 55-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. The Group €22.5 billion in revenues in 2023.
New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Pune, Maharashtra, India
- Career development and training opportunities - Flexible work arrangements (remote and/or office-based) - Dynamic and inclusive work culture within a globally renowned group
No clear work-authorization passage found. Eligibility is unconfirmed.