Time since we first saw it
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 13,882 similar postings that came down. Coming down is not always a hire.
Chennai, TN, IN
Actively hiring, first seen by us 7 hours agoEmployment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
Design and develop ingestion, transformation and enrichment pipelines in Python, PySpark and SQL
Write and optimize complex SQL queries, UDFs and window functions for reporting
Maintain CI/CD pipelines (Git, Jenkins, Docker) for building, testing and deploying jobs
Monitor production workloads and troubleshoot bottlenecks, memory issues and job failures
Document data lineage, pipeline design and operational run books
Design & develop robust ingestion, transformation, and enrichment pipelines with Python, PySpark, and SQL.
Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation and reporting.
Maintain CI/CD pipelines (Git, Jenkins, Docker) for automated build, test, and deployment of jobs.
Monitor production workloads and troubleshoot performance bottlenecks, memory issues, and job failures.
Document data lineage, pipeline design, and operational run books in Confluence/SharePoint.
. Ability to synthetize / simplify
. Ability to collaborate / Teamwork
. Ability to deliver / Results driven
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 13,882 similar postings that came down. Coming down is not always a hire.
120 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
This is a great opportunity to join a winning team. CGI offers a competitive compensation package with opportunities for growth and professional development. Benefits for full-time, permanent members start on the first day of employment and include a paid time-off program and profit participation and stock purchase plans. We wish to thank all applicants for their interest and effort in applying for this position, however, only candidates selected for interviews will be contacted. No unsolicited agency referrals please. Direct Responsibilities . Design & develop robust ingestion, transformation, and enrichment pipelines with Python, PySpark, and SQL. . Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation and reporting.
. Participate in Agile ceremonies (sprint planning, daily standups, retrospectives) and help groom the backlogs. . Mentor junior engineers and champion best practices in Python coding, Spark optimization, and data engineering patterns. . Evaluate emerging technologies and deliver proof of concepts for CEFS.
. Strong knowledge about design patterns and development principles. . Inclination and prior experience of working across SQL, Python and ETL. . Strong Hands on experience Python (NumPy, pandas, Python Frameworks, Restful APIs, MS SQL or Oracle.
. Inclination and prior experience of working across SQL, Python and ETL. . Strong Hands on experience Python (NumPy, pandas, Python Frameworks, Restful APIs, MS SQL or Oracle. . PySpark DataFrames, Spark SQL, Structured Streaming, performance tuning (partitioning, caching, broadcast joins).
. Advanced SQL – complex queries, stored procedures, query optimization. . Good Knowledge and experience to use Python packages such as Pandas, NumPy, etc. for cleaning up of Data, Data Wrangling, Analysis of Data and Visualization of Data. . Good experience in development and maintenance of code/scripts in both functional and technical specifications of all applications component, bug fixing and production support.
Technical Skills: o Python o Pyspark
. Good experience in development and maintenance of code/scripts in both functional and technical specifications of all applications component, bug fixing and production support. . Good knowledge on Linux/Unix environment (basic commands, shell scripting, etc.), testing phases, documentation and new framework. . Some experience of working with build tools like Maven & DevOps tools like Bitbucket, Jenkins.
. Design & develop robust ingestion, transformation, and enrichment pipelines with Python, PySpark, and SQL. . Write and optimize complex SQL queries, analytical UDFs, and window functions for data aggregation and reporting. . Collaborate with CEFS data architects, data scientists, and business analysts to translate functional requirements into technical specifications.
. Strong Hands on experience Python (NumPy, pandas, Python Frameworks, Restful APIs, MS SQL or Oracle. . PySpark DataFrames, Spark SQL, Structured Streaming, performance tuning (partitioning, caching, broadcast joins). . Advanced SQL – complex queries, stored procedures, query optimization.
. PySpark DataFrames, Spark SQL, Structured Streaming, performance tuning (partitioning, caching, broadcast joins). . Advanced SQL – complex queries, stored procedures, query optimization. . Good Knowledge and experience to use Python packages such as Pandas, NumPy, etc. for cleaning up of Data, Data Wrangling, Analysis of Data and Visualization of Data.
o Pyspark o SQL o ETL
. Unit test, integrate test, and review code. . Maintain CI/CD pipelines (Git, Jenkins, Docker) for automated build, test, and deployment of jobs. . Monitor production workloads and troubleshoot performance bottlenecks, memory issues, and job failures.
Specific Qualifications: . Good to have knowledge of front end technologies preferably Flask. Skills Referential (Required knowledge, skills and abilities)
o Python o Pyspark o SQL
Complete your application on cgi.njoyn.com. The employer’s form will show what is required.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Chennai, TN, IN
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.