Software Engineer - Data Engineering
Bangalore, Karnataka
- Pay
- Pay not listed
- Work setting
- Not stated
- Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting
What you’ll work on
Full postingDesign, develop and maintain scalable data pipelines on AWS (S3, Glue, Lambda, Redshift, EMR)
Build and tune Snowflake data warehousing solutions, including data modeling
Write reusable Python and SQL code for data transformation and processing
Monitor, troubleshoot and improve pipeline performance and reliability
Ensure data quality, integrity and security across all pipeline stages
From the employer’s posting
Design, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR.
Build and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling.
Write efficient and reusable code in Python and SQL for data transformation and processing.
Monitor, troubleshoot, and improve pipeline performance and reliability.
Ensure data quality, integrity, and security across all stages of the pipeline.
Tools in this posting
- Python
- SQL
- AWS
- Azure
- Kafka
- Neo4j
- Redshift
- S3
- Snowflake
- Spark
Source — Tool mentions in context
When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it. Job Summary We are looking for a highly motivated and experienced Data Engineer to join our data engineering team. The ideal candidate will have a strong background in building scalable data pipelines using the AWS cloud stack and extensive hands-on experience with Snowflake. Proficiency in Python and SQL, along with graph and vector database technologies, is essential. This role requires strong problem-solving abilities and a proactive mindset to deliver efficient, scalable, and reliable data solutions. ________________________________________ Key Responsibilities • Design, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR. • Build and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling. • Write efficient and reusable code in Python and SQL for data transformation and processing. • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements. • Monitor, troubleshoot, and improve pipeline performance and reliability. • Ensure data quality, integrity, and security across all stages of the pipeline. • Participate in code reviews, architecture discussions, and continuous improvement initiatives. ________________________________________ Required Qualifications • 5-8 years of experience in data engineering or related roles. • Strong hands-on experience with AWS cloud services, including data and AI workloads. • Deep understanding of Snowflake architecture, performance tuning, and best practices. • Advanced proficiency in Python and SQL for data pipelines, transformations, and services. • Strong understanding of graph and vector data modelling concepts and their practical applications. • Experience developing and operating CI/CD pipelines (GitHub Actions)and cloud native deployments. • Experience working with Azure DevOps (AzDO) boards for backlog management in Agile environments. • Excellent analytical and problem-solving skills. • Strong communication and collaboration abilities. • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. ________________________________________ Nice to Have skills • Knowledge of the NVIDIA ecosystem and its applications in data and AI. • Hands on experience with Vector (Milvus or similar) and Graph (Neo4J or similar) databases ________________________________________ Preferred Qualifications • Experience with orchestration tools such as AWS Step Functions. • Familiarity with data governance and compliance practices. • Exposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming). Posting Dates:
Posting record
Report an error- Status in our records
- Live
- First seen by us
- Oct 28, 2026 · 1 day ago
- Recorded sightings
- 5
- Last seen by us
- Oct 30, 2026
- Reposted
- once since Sep 3, 2026
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
Your next step
- Have your resume and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
- Ask the employer about the pay range before committing time to the process.
Complete your application on cat.wd5.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
Job description
Career Area:
Technology, Digital and DataJob Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Job Summary
We are looking for a highly motivated and experienced Data Engineer to join our data engineering team. The ideal candidate will have a strong background in building scalable data pipelines using the AWS cloud stack and extensive hands-on experience with Snowflake. Proficiency in Python and SQL, along with graph and vector database technologies, is essential. This role requires strong problem-solving abilities and a proactive mindset to deliver efficient, scalable, and reliable data solutions.
________________________________________
Key Responsibilities
• Design, develop, and maintain scalable data pipelines on AWS using services such as S3, Glue, Lambda, Redshift, and EMR.
• Build and optimize data warehousing solutions using Snowflake, including performance tuning and data modeling.
• Write efficient and reusable code in Python and SQL for data transformation and processing.
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements.
• Monitor, troubleshoot, and improve pipeline performance and reliability.
• Ensure data quality, integrity, and security across all stages of the pipeline.
• Participate in code reviews, architecture discussions, and continuous improvement initiatives.
________________________________________
Required Qualifications
• 5-8 years of experience in data engineering or related roles.
• Strong hands-on experience with AWS cloud services, including data and AI workloads.
• Deep understanding of Snowflake architecture, performance tuning, and best practices.
• Advanced proficiency in Python and SQL for data pipelines, transformations, and services.
• Strong understanding of graph and vector data modelling concepts and their practical applications.
• Experience developing and operating CI/CD pipelines (GitHub Actions)and cloud native deployments.
• Experience working with Azure DevOps (AzDO) boards for backlog management in Agile environments.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration abilities.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
________________________________________
Nice to Have skills
• Knowledge of the NVIDIA ecosystem and its applications in data and AI.
• Hands on experience with Vector (Milvus or similar) and Graph (Neo4J or similar) databases
________________________________________
Preferred Qualifications
• Experience with orchestration tools such as AWS Step Functions.
• Familiarity with data governance and compliance practices.
• Exposure to real-time data processing frameworks (e.g., Kafka, Spark Streaming).
Posting Dates:
October 28, 2026 - November 3, 2026Caterpillar is an Equal Opportunity Employer. Qualified applicants of any age are encouraged to apply
Not ready to apply? Join our Talent Community.
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
No pay amount identified in the saved description.
- Location & working pattern
Bangalore, Karnataka
Working pattern and location restrictions need checking in the full posting.
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.