Time since we first saw it
Day 197
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Gurugram, India
Open 6 months, first seen by us 197 days agoCreate and manage data ingestion pipelines using Databricks, Airflow, Kafka and Terraform
Optimize large-scale data pipelines for performance, reliability and efficiency
Develop data processing workflows with Databricks, Delta Lake and Spark
Maintain and improve the Data Lakehouse using Unity Catalog
Build automation, frameworks and tools to streamline data engineering workflows
Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform.
Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines.
Develop data processing workflows using Databricks, Delta Lake, and Spark technologies.
Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery.
Construct automation, frameworks, and enhanced tools to streamline data engineering workflows.
Hands-on experience with Databricks, Delta Lake, Spark, and Scala.
Proven ability to design, build, and operate Data Lakes or Data Warehouses.
Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect).
Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell).
Experience with data catalog and metadata management (Unity Catalog, Lakeformation).
Experience in Infrastructure as Code (IaC) using Terraform.
PayPay, a fintech company providing a service enjoyed by over 75 million users since its launch in 2018 in Japan.
In the employer’s words · Read in context
Open 6 monthsWe first saw this posting 197 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 197
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
1 open job
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell). - Strong command of at least one primary language (Scala, Python, etc.) and SQL. - Experience with data catalog and metadata management (Unity Catalog, Lakeformation).
Job Description PayPay India is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our customers. This platform is vital to support our increasing business demands. The Data Pipeline team is tasked with creating, deploying, and managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite. We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization.
- Minimum 7 years as a Data Engineer or similar role. - Hands-on experience with Databricks, Delta Lake, Spark, and Scala. - Proven ability to design, build, and operate Data Lakes or Data Warehouses.
Main Responsibilities - Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. - Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines.
- Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. - Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. - Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery.
- Proven ability to design, build, and operate Data Lakes or Data Warehouses. - Proficiency with Data Orchestration tools (Airflow, Dagster, Prefect). - Familiarity with Change Data Capture tools (Canal, Debezium, Maxwell).
- Experience with data catalog and metadata management (Unity Catalog, Lakeformation). - Experience in Infrastructure as Code (IaC) using Terraform. - Excellent problem-solving and debugging abilities for complex data challenges.
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
To build our Payment services, we got technical cooperation from Paytm (A large payment service company in India). And based on their customer-first technologies , we created and expanded the smartphone payment service in Japan. Therefore, we have decided to establish a development base in India, because it is a major IT country with many talented engineers, as evidenced by the fact that cutting-edge mobile payments can continue to be generated.
PayPay India is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our customers. This platform is vital to support our increasing business demands. The Data Pipeline team is tasked with creating, deploying, and managing this platform, utilizing leading technologies like Databricks, Delta Lake, Spark, PySpark, Scala, and the AWS suite.
We are actively seeking skilled Data Engineers to join our team and contribute to scaling our platform across the organization.
Main Responsibilities
Qualifications
*Please note that you cannot apply for PayPay (Japan-based jobs) or other positions in parallel or in duplicate.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Gurugram, India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.