Location: Bengaluru
Employment Type: Full-Time
Design, build and operate reusable, governed and scalable data products by integrating data from fragmented enterprise, engineering and manufacturing systems.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
Azure
Databricks
Delta Lake
Docker
Kafka
Power BI
Snowflake
Spark
PySpark
Where the posting names them
Data Engineering
- Build production-grade ETL/ELT pipelines using Python, SQL, PySpark/Spark and relevant cloud technologies.
- Develop transformations from raw/source-aligned data into clean, standardized and reusable business data.
Technical SkillsMust Have
- Python
- SQL
- Expose data through appropriate mechanisms such as:- Lakehouse tables
- SQL endpoints
- APIs
- Python
- SQL
- PySpark / Apache Spark
- Microsoft Fabric
- Azure Data Factory
- Azure Databricks
Description - ExternalJob Description: Data Product Engineer (3-8 Years Overall Experience)
Location: Bengaluru
Employment Type: Full-Time
Design, build and operate reusable, governed and scalable data products by integrating data from fragmented enterprise, engineering and manufacturing systems.
The role will build the actual data layer that abstracts source-system complexity and provides reliable data for applications, analytics, AI/ML and GenAI solutions.
Key Responsibilities
Source Integration
Connect and ingest data from heterogeneous systems including databases, APIs, files, cloud platforms, enterprise applications, manufacturing systems and event streams.
Develop batch, incremental, CDC and streaming ingestion pipelines.
Understand source-system structures and map them into standardized domain models.
Data Engineering
Build production-grade ETL/ELT pipelines using Python, SQL, PySpark/Spark and relevant cloud technologies.
Develop transformations from raw/source-aligned data into clean, standardized and reusable business data.
Build robust orchestration, scheduling, error handling and recovery mechanisms.
Optimize data pipelines for reliability, scalability, performance and cost.
Data Product Development
Develop reusable data products rather than application-specific extracts.
Implement domain and canonical data models defined with the Data Architect.
Define and implement data-product schemas and contracts.
Expose data through appropriate mechanisms such as:
Lakehouse tables
SQL endpoints
APIs
Events
Semantic models
Data Quality & Observability
Build automated data-quality validations.
Implement monitoring, alerting and observability.
Handle schema changes and source-system changes.
Implement lineage and metadata requirements.
Perform root-cause analysis for pipeline and data-quality failures.
Software Engineering
Apply Git-based development and branching practices.
Implement CI/CD for data pipelines.
Develop automated unit and integration tests.
Participate in peer reviews and technical design discussions.
Build reusable engineering components and frameworks.
AI Data Enablement
Prepare structured and unstructured data for AI/ML and GenAI applications.
Build pipelines supporting AI use cases and enterprise knowledge layers.
Exposure to embeddings, vector databases and RAG architectures is desirable.
Technical Skills
Must Have
Python
SQL
PySpark / Apache Spark
ETL/ELT
Data modeling
APIs
Git
CI/CD
Data quality and testing
Platform Experience Experience in one or more of:
Microsoft Fabric
Azure Data Factory
Azure Databricks
ADLS
Delta Lake
Apache Kafka / Event Hubs
Snowflake or equivalent
Good to Have
Power BI semantic models
API development
Event-driven architectures
Docker
AI/ML pipelines
Vector databases
RAG / GenAI data engineering
Preferred Manufacturing Experience
Manufacturing / automotive data
MES / ERP / production-planning systems
Shopfloor and equipment data
IoT/telemetry
Engineering data
Qualifikationen
Description - ExternalJob Description: Data Product Engineer (3-8 Years Overall Experience)
Location: Bengaluru
Employment Type: Full-Time
Design, build and operate reusable, governed and scalable data products by integrating data from fragmented enterprise, engineering and manufacturing systems.
The role will build the actual data layer that abstracts source-system complexity and provides reliable data for applications, analytics, AI/ML and GenAI solutions.
Key Responsibilities
Source Integration
Connect and ingest data from heterogeneous systems including databases, APIs, files, cloud platforms, enterprise applications, manufacturing systems and event streams.
Develop batch, incremental, CDC and streaming ingestion pipelines.
Understand source-system structures and map them into standardized domain models.
Data Engineering
Build production-grade ETL/ELT pipelines using Python, SQL, PySpark/Spark and relevant cloud technologies.
Develop transformations from raw/source-aligned data into clean, standardized and reusable business data.
Build robust orchestration, scheduling, error handling and recovery mechanisms.
Optimize data pipelines for reliability, scalability, performance and cost.
Data Product Development
Develop reusable data products rather than application-specific extracts.
Implement domain and canonical data models defined with the Data Architect.
Define and implement data-product schemas and contracts.
Expose data through appropriate mechanisms such as:
Lakehouse tables
SQL endpoints
APIs
Events
Semantic models
Data Quality & Observability
Build automated data-quality validations.
Implement monitoring, alerting and observability.
Handle schema changes and source-system changes.
Implement lineage and metadata requirements.
Perform root-cause analysis for pipeline and data-quality failures.
Software Engineering
Apply Git-based development and branching practices.
Implement CI/CD for data pipelines.
Develop automated unit and integration tests.
Participate in peer reviews and technical design discussions.
Build reusable engineering components and frameworks.
AI Data Enablement
Prepare structured and unstructured data for AI/ML and GenAI applications.
Build pipelines supporting AI use cases and enterprise knowledge layers.
Exposure to embeddings, vector databases and RAG architectures is desirable.
Technical Skills
Must Have
Python
SQL
PySpark / Apache Spark
ETL/ELT
Data modeling
APIs
Git
CI/CD
Data quality and testing
Platform Experience Experience in one or more of:
Microsoft Fabric
Azure Data Factory
Azure Databricks
ADLS
Delta Lake
Apache Kafka / Event Hubs
Snowflake or equivalent
Good to Have
Power BI semantic models
API development
Event-driven architectures
Docker
AI/ML pipelines
Vector databases
RAG / GenAI data engineering
Preferred Manufacturing Experience
Manufacturing / automotive data
MES / ERP / production-planning systems
Shopfloor and equipment data
IoT/telemetry
Engineering data
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.