Data Engineer III

Chennai

Actively hiring, first seen by us 5 hours ago

Pay: Pay not listed
Work setting: On-site — work setting source
Work setup in the employer’s posting: onsite
From the employer’s posting
Employment: Full-time — employment source
Employment type Full-time
Employment type in the employer’s posting: Full-time
From the employer’s posting

What you’ll work on

Full posting

Design and maintain scalable data systems and ETL pipelines
Perform data modeling and big data architecture design
Administer and tune big data databases and compute engines
Troubleshoot and fix data problems and defects
Mentor other team members

From the employer’s posting

Build highly reliable & scalable data systems with good data governance

Perform Data Modeling, Big data architecture design, support and implementation of OLTP, real time OLAP/data warehouse systems and ETL pipelines.

Hands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniques

Identify, analyze and back track data problems as needed.

Mentor other team members

What you’ll bring

All qualifications

Core experience

At least 7 years in data engineering and data modeling
At least 7 years coding in Java, Python, R or equivalent
At least 4 years of big data experience
At least 2 years as technical lead on data lake or warehouse systems
AWS data lake and warehouse experience (S3, Redshift, EMR, Glue)

Qualification wording

At least 7 years’ experience in data engineering, Data modeling, SQL, ETL

At least 7 years coding experience in Java, Python, R or other equivalent programming language

At least 4 years big data experience

At least 2 years’ experience as technical lead architecting data lake/data warehouse/lake house systems

Experience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR

Apply at Pditechnologies

Posting record

Report an error

Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.

Status in our records: Live
First seen by us: Nov 11, 2026today
Recorded sightings: 1

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 0

Early. Similar jobs usually come down between day 6 and day 55.

From 12,976 similar postings that came down. Coming down is not always a hire.

Pditechnologies is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

Java
Python
R
SQL
AWS
Azure
GCP
Hadoop
Iceberg
Redshift
S3
Spark
Airflow

Where the posting names them

- At least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database, Data warehousing & basic-level administration of data infrastructure - At least 7 years coding experience in Java, Python, R or other equivalent programming language - At least 4 years big data experience

- Experience in building pipelines, ingesting data from heterogeneous systems onto data lake environments in real time - Proficient in Python, SQL and PL-SQL, query tuning, optimization, ETL, ELT, and Data Warehousing - Proficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database tables, pipeline design and tasks.

- Deploy and manage changes in development, staging and production. - Assist development and dev ops teams on SQL queries and tuning. Required Skills & Experience:

Required Skills & Experience: - At least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database, Data warehousing & basic-level administration of data infrastructure - At least 7 years coding experience in Java, Python, R or other equivalent programming language

- Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc., handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg, & managing/working with different OLTP systems & data ingestion mechanisms. - Experience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR - Experience with data orchestration tools like Airflow

Other Skills and Experience - Cloud experience, such as AWS, GCP or Azure - Building/Managing data lake & lake house architectures.

- At least 2 years’ experience as technical lead architecting data lake/data warehouse/lake house systems & mentoring team of Data Engineers / DBAs - Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc., handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg, & managing/working with different OLTP systems & data ingestion mechanisms. - Experience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR

- Track/Build & monitor data/system KPI’s like storage, performance & usage - Hands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniques - Prepare required documentation as outlined by departmental standards.

- Experience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR - Experience with data orchestration tools like Airflow - Experience in building pipelines, ingesting data from heterogeneous systems onto data lake environments in real time

Upload resume Add LinkedIn

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.

August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025: $139,500
Expected change, 2025 to 2035: 9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Job description

View original posting ↗

For nearly 40 years, PDI has helped convenience retailers and petroleum wholesalers adapt to changes in the industry by leveraging the latest technologies. Simplifying the complexity in your world is our main focus. That's why we're delivering an integrated portfolio of global, cloud-based solutions and services to meet our customers needs today and well into the future. From the back office to fuel logistics, and the latest wave of consumer demands and digital commerce, PDI solutions and services are designed to give you a competitive edge. Our deep domain knowledge is backed by our industry-specific software offerings and a people-first approach. Serving the entire supply chain means that we’ve had to solve a wide range of industry challenges and deliver measurable value. To address the increasingly dynamic convenience retail and petroleum wholesale industry, PDI leads the way with converged digital, cloud-optimized, secure, and scalable solutions including ERP, Loyalty, Fuel Pricing, Point-of-Sale and Logistics to create a broader industry ecosystem. The result is unparalleled insights, simplified operations, and higher profitability for your employees and business. We’re dedicated to helping our more than 1,500 customers in over 50 countries, providing solutions and services to over 200,000 sites.

The Opportunity:

If you love to develop great quality software and are eager to learn new technologies and develop new skills, then we have a great opportunity for you: join our PDI family and work closely with other talented PDI engineers to deliver solutions that delight our customers every day!

As a Data Engineer III, you will be part of an agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies. The candidate will help with design, development, unit testing, performance testing, deployment, troubleshooting, defect resolution, and support of our

Job Responsibilities:

Utilize architectural and design skills for a variety of data-oriented tasks.
Establish and maintain strong relationships with business stakeholders.
Build highly reliable & scalable data systems with good data governance that provide complete, secure, accurate and timely data for analytics.
Expertise in data & dimensional modeling with good business acumen in supporting new product features and services - including financial reporting. 
Assist development and analytics organization to meet its delivery goals with regards to data design, flow and infrastructure.
Perform Data Modeling, Big data architecture design, support and implementation of OLTP, real time OLAP/data warehouse systems and ETL pipelines.
Track/Build & monitor data/system KPI’s like storage, performance & usage
Hands on administration of big data databases/compute engines (Redshift, EMR, Spark or similar) and optimization/tuning techniques
Prepare required documentation as outlined by departmental standards.
Identify, analyze and back track data problems as needed.
Provide recommendations for application and system improvements.
Mentor other team members
Work with business users to understand business requirements, issues and business and/or client processes.
Develop, test, and maintain high-performance of our data systems to meet the requirements of the business and/clients while adhering to departmental standards.
Perform quality assurance testing for all work performed.
Meet with agile teams as required to define and document application requirements.
Follow project development, deployment process & maintain industry standards and best coding practices.
Maintain security and organization of the company’s data.
Provide off-hour support as assigned.
Gather business requirements/features, estimate the tasks, design & develop scalable solutions.
Work with manager to ascertain the company’s data requirements.
Plan work to meet project deadlines, accommodate demands by development teams, set priorities and escalate issues appropriately.
 Provide recommendations to development teams for data restructuring and performing complex maintenance.
Deploy and manage changes in development, staging and production.
Assist development and dev ops teams on SQL queries and tuning.

Required Skills & Experience:

At least 7 years’ experience in data engineering, Data modeling, SQL, ETL, Big database, Data warehousing & basic-level administration of data infrastructure
At least 7 years coding experience in Java, Python, R or other equivalent programming language
At least 4 years big data experience
At least 2 years’ experience as technical lead architecting data lake/data warehouse/lake house systems & mentoring team of Data Engineers / DBAs
Proficient in a variety of big-data tools and technologies, including Hadoop, Spark, etc., handling different storage formats like Parquet, Delta/Apache Hudi/Apache Iceberg, & managing/working with different OLTP systems & data ingestion mechanisms.
Experience building large scale data lakes & warehouse systems leveraging cloud environments including AWS technologies –S3, Redshift, Aurora/RDS, DMS, EC2, Glue spark, Cloud watch, & EMR
Experience with data orchestration tools like Airflow
Experience in building pipelines, ingesting data from heterogeneous systems onto data lake environments in real time
Proficient in Python, SQL and PL-SQL, query tuning, optimization, ETL, ELT, and Data Warehousing
Proficient in Business Intelligence (BI), analytic database and products, able to take business requirements and translate into database tables, pipeline design and tasks.
General data-specific concepts, frameworks and processes
Agile development practices
Working within an SDLC
Designing data warehouses including definition, structure, documentation, maintenance, long-range requirements, operational guidelines, and protection
Data governance, meta data management, data security measures, retention & archival across data lake layers

Other Skills and Experience

Cloud experience, such as AWS, GCP or Azure
Building/Managing data lake & lake house architectures.
Experience working on different data lake storage formats.
Excellent oral and written communication
Multi-tasking and managing multiple priorities.
Working well in a team-oriented, collaborative environment with people from different disciplines and varying degrees of technical experience
Working in an Agile team environment.

Behavioral Competencies:

Cultivates Innovation

Decision Quality

Manages Complexity

Drives Results

Business Insight

PDI is committed to offering a well-rounded benefits program, designed to support and care for you, and your family throughout your life and career. This includes a competitive salary, market-competitive benefits, and a quarterly perks program. We encourage a good work-life balance with ample time off [time away] and, where appropriate, hybrid working arrangements. Employees have access to continuous learning, professional certifications, and leadership development opportunities. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.

Employment type

Full-time

Source details