Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Bangalore, Karnataka, India
Open 5 months, first seen by us 172 days agoLocation: Bangalore (5 days work from office, HSR Layout) Job Type: Full Time Industry: Agritech
Employment type in the employer’s posting: FULL_TIMEFrom the employer’s posting
Design, build and optimize scalable data pipelines for structured and unstructured data
Architect and maintain data lakes, warehouses and databases
Integrate data from APIs, third-party systems and streaming platforms
Automate data ingestion, transformation and validation
Mentor and guide junior data engineers
Design, build, and optimize scalable, secure, and reliable data pipelines
Architect and maintain data storage solutions, including data lakes, data warehouses, and databases
Integrate data from diverse sources, including APIs, third-party systems, and streaming platforms
Develop automated processes for data ingestion, transformation, and validation
Guide and mentor junior data engineers
â Technical Skills: â Proficiency in programming languages such as Python, Java, or Scala. â Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
data lakehouse python etl pipelines
Openings: Multiple- junior, mid level etc Python- Mandatory Â
NoSQL SQL Location: Bangalore (5 days work from office, HSR Layout)
â Proficiency in programming languages such as Python, Java, or Scala. â Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra). â Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., Redshift, BigQuery, Snowflake).
â Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra). â Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., Redshift, BigQuery, Snowflake). â Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and data integration frameworks.
â Ability to work in a fast-paced, dynamic environment and manage multiple priorities. â Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics, Google Professional Data Engineer) or relevant data engineering certifications. Â
â Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed systems. â Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus. â Soft Skills:
â Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and data integration frameworks. â Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed systems. â Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.
â Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., Redshift, BigQuery, Snowflake). â Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and data integration frameworks. â Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed systems.
Databases NoSQL SQL
â Familiarity with machine learning pipelines and MLOps practices. â Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data pipelines. â Experience in industries with high data complexity, such as finance, healthcare, or e-commerce.
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
1 open job
Check the employer’s posting for the current role and application details.
Already applied? Track this application
data lakehouse
python
etl pipelines
Data Engineering
apache hop
Databases
NoSQL
SQL
Location: Bangalore (5 days work from office, HSR Layout)
Job Type: Full Time
Industry: Agritech
Openings: Multiple- junior, mid level etc
Python- Mandatory
Â
Overview
The Data Engineer/ Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support data-driven decision-making and advanced analytics. This role requires deep expertise in data engineering, strong problem-solving skills, and the ability to collaborate with cross-functional teams to deliver robust data solutions.
Â
Key Responsibilities
â Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data pipelines to ingest, process, and transform large volumes of structured and unstructured data.
â Data Architecture: Architect and maintain data storage solutions, including data lakes, data warehouses, and databases, ensuring performance, scalability, and cost-efficiency.
â Data Integration: Integrate data from diverse sources, including APIs, third-party systems, and streaming platforms, ensuring data quality and consistency.
â Performance Optimization: Monitor and optimize data systems for performance, scalability, and cost, implementing best practices for partitioning, indexing, and caching.
â Collaboration: Work closely with data scientists, analysts, and software engineers to understand data needs and deliver solutions that enable advanced analytics, machine learning, and reporting.
â Data Governance: Implement data governance policies, ensuring compliance with data security, privacy regulations (e.g., GDPR, CCPA), and internal standards.
â Automation: Develop automated processes for data ingestion, transformation, and validation to improve efficiency and reduce manual intervention.
â Mentorship: Guide and mentor junior data engineers, fostering a culture of technical excellence and continuous learning.
â Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high availability and reliability of data systems.
Â
Required Qualifications
â Education: Bachelorâs or Masterâs degree in Computer Science, Engineering, Data Science, or a related field.
â Experience: 5+ years of experience in data engineering or a related role, with a proven track record of building scalable data pipelines and infrastructure.
â Technical Skills:
â Proficiency in programming languages such as Python, Java, or Scala.
â Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).
â Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., Redshift, BigQuery, Snowflake).
â Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and data integration frameworks.
â Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed systems.
â Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.
â Soft Skills:
â Excellent problem-solving and analytical skills.
â Strong communication and collaboration abilities.
â Ability to work in a fast-paced, dynamic environment and manage multiple priorities.
â Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics, Google Professional Data Engineer) or relevant data engineering certifications.
Â
Preferred Qualifications
â Experience with real-time data processing and streaming architectures.
â Familiarity with machine learning pipelines and MLOps practices.
â Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data pipelines.
â Experience in industries with high data complexity, such as finance, healthcare, or e-commerce.
Â
Work Environment
â Team: Collaborative, cross-functional team environment with data scientists, analysts, and business stakeholders.
â Hours: Full-time, with occasional on-call responsibilities for critical data systems
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Bangalore, Karnataka, India
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting