Back to jobs

Senior Data Engineer

Pune Corporate Office - Mantri, India

Actively hiring, first seen by us 10 days ago
Pay
Pay not listed
Work setting
Not stated
Employment
Permanent — employment source
Employment type in the employer’s posting: Permanent
From the employer’s posting

What you’ll work on

Full posting
  • Design GenAI-powered BI solutions using Databricks Genie or MS Fabric

  • Design Semantic Models and reusable, governed Metric Views

  • Build scalable PySpark and SQL pipelines on Azure Databricks

  • Develop and orchestrate ETL workflows in Azure Data Factory

  • Implement CI/CD pipelines for data and AI workflows

From the employer’s posting
Design and implement GenAI-powered BI solutions using Databricks Genie or MS Fabric
Design and manage Semantic Models for business abstraction
Build scalable pipelines using Azure Databricks (PySpark, SQL)
Develop and orchestrate ETL workflows using Azure Data Factory
Implement CI/CD pipelines for data and AI workflows

What you’ll bring

All qualifications

Core experience

  • Azure Databricks with PySpark, SQL and Delta Lake
  • Strong experience in semantic modeling and metrics layer design
  • Hands-on experience with Databricks Genie or GenAI-based BI workflows
  • Prompt engineering or instruction tuning for AI systems
  • Python (Pandas, PySpark, FastAPI) and strong SQL and data modeling
Qualification wording
Azure Databricks – PySpark, SQL, Delta Lake
Strong experience in Semantic Modeling & Metrics Layer design
Hands-on with Databricks Genie / GenAI-based BI workflows
Prompt Engineering / Instruction tuning for AI systems
Python (Pandas, PySpark, FastAPI)
Apply at Bajaj Finance

Posting record

Report an error

Actively hiringFirst seen by us 10 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 12, 202610 days ago
Recorded sightings
9
Last seen by us
Nov 21, 2026
Employer says posted
May 29, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 10

Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Bajaj Finance is hiring

32 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C#
  • Python
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • MongoDB
  • NoSQL
  • Power BI
  • FastAPI
  • pandas
  • PySpark
Where the posting names them
Major Challenges MAJOR CHALLENGES • Ensuring accuracy and trust in AI-generated insights • Driving adoption of GenAI-based BI over traditional dashboards • Maintaining semantic consistency across multiple tools • Balancing performance, cost, and scalability • Managing dependencies across data engineering, AI, and business teams Required Qualifications and Experience REQUIRED SKILLS & EXPERIENCE Must Have • Azure Databricks – PySpark, SQL, Delta Lake • Strong experience in Semantic Modeling & Metrics Layer design • Hands-on with Databricks Genie / GenAI-based BI workflows • Databricks One (Unified BI Experience) • Prompt Engineering / Instruction tuning for AI systems • Python (Pandas, PySpark, FastAPI) • Azure Data Factory (ADF) for ETL pipelines • Strong SQL and data modeling skills Good to Have • Cosmos DB / MongoDB (NoSQL concepts) • Azure Data Explorer (KQL) ________________________________________ DATA STACK (MANDATORY FOR SCREENING) SNo Data Platform / Concepts Associated Technologies 1 Databricks Lakehouse PySpark, SQL, Delta Lake 2 AI for BI Databricks Genie, Genie Rooms, Instructions, Agents 3 Semantic Layer Semantic Models, Metric Views 4 ETL & Orchestration Azure Data Factory 5 Programming Python, C#/.NET 6 Cloud Platform Azure (Preferred) 10 DevOps CI/CD Pipelines, Git ________________________________________ ? SOFT SKILLS • Strong analytical and problem-solving mindset • Ability to bridge business + data + AI • Effective stakeholder communication • Ownership-driven and proactive approach • Ability to work in fast-paced, evolving AI landscape
Job Purpose To design and deliver AI-powered Business Intelligence solutions by integrating Databricks Genie, Semantic Models, and Metric Views on top of a robust end-to-end data engineering stack. The role focuses on enabling self-service analytics using natural language (GenAI), ensuring business-friendly data consumption, and building governed, scalable, and high-performance data ecosystems across batch and real-time pipelines. Duties and Responsibilities KEY ROLES / PRINCIPAL ACCOUNTABILITIES AI for BI & GenAI Enablement • Design and implement GenAI-powered BI solutions using Databricks Genie or MS Fabric • Create and manage Data Rooms for business users with curated datasets • Define and maintain Instructions Layer (prompt engineering for business context) • Enable natural language to SQL/insights workflows for self-service analytics • Drive adoption of Databricks One & other platforms as a unified analytics interface Semantic Layer & Metrics Engineering • Design and manage Semantic Models for business abstraction • Develop reusable and governed Metric Views (KPIs, aggregations, business definitions) • Ensure consistency across BI tools (Power BI / Genie) • Align semantic layer with business glossary and data governance policies Data Engineering & Platform Development • Build scalable pipelines using Azure Databricks (PySpark, SQL) • Develop and orchestrate ETL workflows using Azure Data Factory • Work with Delta Lake architecture (Bronze–Silver–Gold layers) • Enable real-time and batch data processing pipelines • Enable data exposure via APIs for BI and downstream systems CI/CD & DevOps • Implement CI/CD pipelines for data and AI workflows • Automate deployments across environments (Dev, QA, Prod) • Ensure version control and reproducibility ________________________________________ ? KEY RESPONSIBILITIES • Translate business problems into AI-driven BI solutions • Own end-to-end delivery: ingestion ? transformation ? semantic layer ? AI consumption • Design scalable data architecture aligned with lakehouse principles • Ensure data quality, governance, and metric consistency • Collaborate with business teams to onboard them onto Genie-based analytics • Optimize performance of queries, pipelines, and AI responses • Establish best practices for AI in BI (prompting, semantic tuning, governance) • Drive adoption of self-service BI with minimal dependency on tech teams Key Decisions / Dimensions KEY DECISIONS / DIMENSIONS • Define semantic layer design and metric definitions • Decide GenAI prompting strategies and instruction frameworks • Prioritize data vs AI optimization trade-offs • Handle production issues with RCA and long-term fixes • Drive architectural decisions for lakehouse + AI integration
Job Purpose To design and deliver AI-powered Business Intelligence solutions by integrating Databricks Genie, Semantic Models, and Metric Views on top of a robust end-to-end data engineering stack. The role focuses on enabling self-service analytics using natural language (GenAI), ensuring business-friendly data consumption, and building governed, scalable, and high-performance data ecosystems across batch and real-time pipelines. Duties and Responsibilities KEY ROLES / PRINCIPAL ACCOUNTABILITIES AI for BI & GenAI Enablement • Design and implement GenAI-powered BI solutions using Databricks Genie or MS Fabric • Create and manage Data Rooms for business users with curated datasets • Define and maintain Instructions Layer (prompt engineering for business context) • Enable natural language to SQL/insights workflows for self-service analytics • Drive adoption of Databricks One & other platforms as a unified analytics interface Semantic Layer & Metrics Engineering • Design and manage Semantic Models for business abstraction • Develop reusable and governed Metric Views (KPIs, aggregations, business definitions) • Ensure consistency across BI tools (Power BI / Genie) • Align semantic layer with business glossary and data governance policies Data Engineering & Platform Development • Build scalable pipelines using Azure Databricks (PySpark, SQL) • Develop and orchestrate ETL workflows using Azure Data Factory • Work with Delta Lake architecture (Bronze–Silver–Gold layers) • Enable real-time and batch data processing pipelines • Enable data exposure via APIs for BI and downstream systems CI/CD & DevOps • Implement CI/CD pipelines for data and AI workflows • Automate deployments across environments (Dev, QA, Prod) • Ensure version control and reproducibility ________________________________________ ? KEY RESPONSIBILITIES • Translate business problems into AI-driven BI solutions • Own end-to-end delivery: ingestion ? transformation ? semantic layer ? AI consumption • Design scalable data architecture aligned with lakehouse principles • Ensure data quality, governance, and metric consistency • Collaborate with business teams to onboard them onto Genie-based analytics • Optimize performance of queries, pipelines, and AI responses • Establish best practices for AI in BI (prompting, semantic tuning, governance) • Drive adoption of self-service BI with minimal dependency on tech teams

Your next step

Complete your application on bflcareers.peoplestrong.com. The employer’s form will show what is required.

Already applied? Track this application

Has Bajaj Finance posted this job before?

Yes. We’ve followed 16 other Senior Data Engineer jobs there since November 2026. All 16 are still up.

  1. Pune CorporateStill up after 10 days, first seen Nov 12
  2. Nr Trident Tech ParkStill up after 10 days, first seen Nov 12
  3. Pune CorporateStill up after 10 days, first seen Nov 12
  4. Pune CorporateStill up after 10 days, first seen Nov 12
  5. Pune CorporateStill up after 10 days, first seen Nov 12
  6. Pune CorporateStill up after 10 days, first seen Nov 12
  7. Nr Trident Tech ParkStill up after 10 days, first seen Nov 12
  8. Pune CorporateStill up after 10 days, first seen Nov 12
  9. This jobUp 10 days so far, first seen Nov 12

Large employers often post one title for several teams, so these can be separate openings.

Job description

View original posting ↗

Job Purpose
To design and deliver AI-powered Business Intelligence solutions by integrating Databricks Genie, Semantic Models, and Metric Views on top of a robust end-to-end data engineering stack.
The role focuses on enabling self-service analytics using natural language (GenAI), ensuring business-friendly data consumption, and building governed, scalable, and high-performance data ecosystems across batch and real-time pipelines.Duties and Responsibilities
KEY ROLES / PRINCIPAL ACCOUNTABILITIES
AI for BI & GenAI Enablement
• Design and implement GenAI-powered BI solutions using Databricks Genie or MS Fabric
• Create and manage Data Rooms for business users with curated datasets
• Define and maintain Instructions Layer (prompt engineering for business context)
• Enable natural language to SQL/insights workflows for self-service analytics
• Drive adoption of Databricks One & other platforms as a unified analytics interface
Semantic Layer & Metrics Engineering
• Design and manage Semantic Models for business abstraction
• Develop reusable and governed Metric Views (KPIs, aggregations, business definitions)
• Ensure consistency across BI tools (Power BI / Genie)
• Align semantic layer with business glossary and data governance policies
Data Engineering & Platform Development
• Build scalable pipelines using Azure Databricks (PySpark, SQL)
• Develop and orchestrate ETL workflows using Azure Data Factory
• Work with Delta Lake architecture (Bronze–Silver–Gold layers)
• Enable real-time and batch data processing pipelines
• Enable data exposure via APIs for BI and downstream systems
CI/CD & DevOps
• Implement CI/CD pipelines for data and AI workflows
• Automate deployments across environments (Dev, QA, Prod)
• Ensure version control and reproducibility
________________________________________
?
KEY RESPONSIBILITIES
• Translate business problems into AI-driven BI solutions
• Own end-to-end delivery: ingestion ? transformation ? semantic layer ? AI consumption
• Design scalable data architecture aligned with lakehouse principles
• Ensure data quality, governance, and metric consistency
• Collaborate with business teams to onboard them onto Genie-based analytics
• Optimize performance of queries, pipelines, and AI responses
• Establish best practices for AI in BI (prompting, semantic tuning, governance)
• Drive adoption of self-service BI with minimal dependency on tech teamsKey Decisions / Dimensions
KEY DECISIONS / DIMENSIONS
• Define semantic layer design and metric definitions
• Decide GenAI prompting strategies and instruction frameworks
• Prioritize data vs AI optimization trade-offs
• Handle production issues with RCA and long-term fixes
• Drive architectural decisions for lakehouse + AI integrationMajor Challenges
MAJOR CHALLENGES
• Ensuring accuracy and trust in AI-generated insights
• Driving adoption of GenAI-based BI over traditional dashboards
• Maintaining semantic consistency across multiple tools
• Balancing performance, cost, and scalability
• Managing dependencies across data engineering, AI, and business teamsRequired Qualifications and Experience
REQUIRED SKILLS & EXPERIENCE
Must Have
• Azure Databricks – PySpark, SQL, Delta Lake
• Strong experience in Semantic Modeling & Metrics Layer design
• Hands-on with Databricks Genie / GenAI-based BI workflows
• Databricks One (Unified BI Experience)
• Prompt Engineering / Instruction tuning for AI systems
• Python (Pandas, PySpark, FastAPI)
• Azure Data Factory (ADF) for ETL pipelines
• Strong SQL and data modeling skills
Good to Have
• Cosmos DB / MongoDB (NoSQL concepts)
• Azure Data Explorer (KQL)
________________________________________
DATA STACK (MANDATORY FOR SCREENING)
SNo Data Platform / Concepts Associated Technologies
1 Databricks Lakehouse PySpark, SQL, Delta Lake
2 AI for BI Databricks Genie, Genie Rooms, Instructions, Agents
3 Semantic Layer Semantic Models, Metric Views
4 ETL & Orchestration Azure Data Factory
5 Programming Python, C#/.NET
6 Cloud Platform Azure (Preferred)
10 DevOps CI/CD Pipelines, Git
________________________________________
?
SOFT SKILLS
• Strong analytical and problem-solving mindset
• Ability to bridge business + data + AI
• Effective stakeholder communication
• Ownership-driven and proactive approach
• Ability to work in fast-paced, evolving AI landscape

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Pune Corporate Office - Mantri, India

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.