Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
Bangalore, Karnataka, India
Actively hiring, first seen by us 3 days agoDevelop and maintain data transformation processes using Spark, SQL, Hive, Python or Scala
Build and enhance Airflow workflows, including DAG design, scheduling and failure handling
Build cloud-native data and backend solutions on AWS services
Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications
Troubleshoot production issues and improve system reliability and automation
Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies.
Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling.
Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions.
Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications.
Troubleshoot production issues, improve system reliability, and drive automation across data and backend workflows.
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
5 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Build scalable backend services and data engineering solutions that support data processing and operational workflows. Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies. Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions.
5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem. Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies. Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services.
Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies. Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services. Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies. Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions. Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling.
5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems. 5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem. Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies.
Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services. Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway. Strong experience with Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support.
Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions. Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling. Define technical scope, objectives, and implementation approaches by participating in requirements gathering, technical research, and process definition.
Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway. Strong experience with Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support. Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization.
Complete your application on iaagiz.fa.ocs.oraclecloud.com. The employer’s form will show what is required.
Already applied? Track this application
Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications.
Build scalable backend services and data engineering solutions that support data processing and operational workflows.
Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies.
Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions.
Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling.
Define technical scope, objectives, and implementation approaches by participating in requirements gathering, technical research, and process definition.
Participate in architecture reviews, code reviews, performance tuning, and operational readiness activities.
Contribute to test planning and validation for application integrations, functional areas, and project deliverables.
Partner with product owners, data engineers, backend engineers, QA, DevOps, and other cross-functional teams to deliver high-quality solutions in an Agile/Scrum environment.
Troubleshoot production issues, improve system reliability, and drive automation across data and backend workflows.
5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems.
5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem.
Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies.
Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services.
Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
Strong experience with Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support.
Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization.
Excellent analytical and problem-solving skills.
Strong communication and presentation skills, with the ability to explain technical concepts clearly to both technical and non-technical audiences.
Experience with version control and CI/CD tools, including Git and Jenkins, for source code management, build automation, testing, and deployment workflows.
Ability to work effectively in cross-functional Agile/Scrum teams.
Experience with LLMs, Generative AI, Agentic AI, or AI-assisted engineering workflows.
Experience with API design, microservices, event-driven architecture, or serverless backend development.
Experience with CI/CD pipelines, infrastructure as code, automated testing, and production deployment practices.
Experience with data governance, metadata management, lineage, data observability, or operational controls for enterprise data platforms
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bangalore, Karnataka, India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.