Back to jobs

Databricks Data Specialist

Bangalore, Karnataka, India

Live, first seen by us 83 days ago
Pay
Pay not listed
Work setting
Hybrid — work setting source
Work setup in the employer’s posting: hybrid
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting

We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform.

We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform.

  • Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark.

  • Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers.

  • Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features.

From the employer’s posting
We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will possess strong expertise in Databricks, PySpark, and SQL, with hands-on experience building batch and real-time data pipelines, implementing Lakehouse architectures, and ensuring data governance and performance optimization.
Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark. Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers.
Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark. Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers. Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features.
Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers. Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features. Create, monitor, and optimize Delta Live Tables (DLT) pipelines.

What you’ll bring

All qualifications

Core experience

  • Strong expertise in Databricks, PySpark, and SQL
  • Hands-on Delta Lake and Delta Live Tables experience
  • Experience with Structured Streaming and Auto Loader
  • Lakehouse data modeling skills
  • Bachelor's or Master's degree in Computer Science, Data Engineering, IT, or related field
Qualification wording
strong expertise in Databricks, PySpark, and SQL
Delta Lake Delta Live Tables (DLT)
Structured Streaming Auto Loader
Lakehouse Data Modeling
Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related discipline.
Education & alternatives
Qualifications - Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related discipline. - Proven experience in designing and implementing cloud-based data engineering solutions and scalable data pipelines.
Apply at Brillio-2

Posting record

Report an error
Status in our records
Live
First seen by us
Aug 14, 202683 days ago
Recorded sightings
171
Last seen by us
Nov 5, 2026
Employer says posted
Aug 10, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 83

Up longer than most. Similar jobs usually come down between day 6 and day 54.

Well past Brillio-2’s usual: its jobs come down by about day 25.

From 11,206 similar postings that came down, and 58 of Brillio-2’s. Coming down is not always a hire.

Brillio-2 is hiring

46 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring has slowed
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • SQL
  • AWS
  • Azure
  • BigQuery
  • Databricks
  • dbt
  • Delta Lake
  • Fivetran
  • GCP
  • Kafka
  • Power BI
  • Spark
  • Airflow
  • PySpark
Where the posting names them
Role Overview We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will possess strong expertise in Databricks, PySpark, and SQL, with hands-on experience building batch and real-time data pipelines, implementing Lakehouse architectures, and ensuring data governance and performance optimization. Key Responsibilities
- Establish and enforce data governance, security, and access controls using Unity Catalog. - Optimize Spark jobs, SQL queries, and overall platform performance to ensure efficiency and scalability. - Collaborate with cross-functional teams, including data analysts, architects, and business stakeholders, to deliver high-quality data solutions.
- Auto Loader - SQL - Lakehouse Data Modeling
Key Technologies Databricks | PySpark | Apache Spark | Delta Lake | Delta Live Tables (DLT) | Unity Catalog | Structured Streaming | Auto Loader | SQL | Lakehouse Architecture | Azure | AWS | Airflow | Kafka | Power BI Specialization
Key Technologies Databricks | PySpark | Apache Spark | Delta Lake | Delta Live Tables (DLT) | Unity Catalog | Structured Streaming | Auto Loader | SQL | Lakehouse Architecture | Azure | AWS | Airflow | Kafka | Power BI Employment type
- Microsoft Fabric AWS Ecosystem - AWS Glue
AWS Ecosystem - AWS Glue - AWS Lambda
- AWS Glue - AWS Lambda - AWS Step Functions
- AWS Lambda - AWS Step Functions Data Engineering & Integration
Preferred Skills (Good to Have) Azure Ecosystem - Azure Data Factory (ADF)
Azure Ecosystem - Azure Data Factory (ADF) - Azure Synapse Analytics
- Azure Data Factory (ADF) - Azure Synapse Analytics - Microsoft Purview
GCP - BigQuery Qualifications
Primary Skills Databricks Engineer Role Overview
Key Responsibilities - Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark. - Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers.
- Develop and manage real-time data processing solutions using Structured Streaming. - Orchestrate, schedule, and monitor data workflows using Databricks Workflows. - Design and implement Lakehouse data models to support reporting, analytics, and business intelligence requirements.
Required Skills (Must Have) - Databricks Platform - Delta Lake
- Unity Catalog - Databricks Workflows - PySpark and Apache Spark
Specialization - Databricks Engineering: Lead Data Engineer Job requirements
Job requirements Databricks Engineer Role Overview
- Apache Airflow - DBT - Fivetran
- Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers. - Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features. - Create, monitor, and optimize Delta Live Tables (DLT) pipelines.
- Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features. - Create, monitor, and optimize Delta Live Tables (DLT) pipelines. - Implement scalable and efficient data ingestion processes using Auto Loader.
- Databricks Platform - Delta Lake - Delta Live Tables (DLT)
- Delta Lake - Delta Live Tables (DLT) - Unity Catalog
- DBT - Fivetran - Informatica
- Alation GCP - BigQuery
Streaming & Analytics - Apache Kafka - Power BI
- Apache Kafka - Power BI Data Governance
- Databricks Workflows - PySpark and Apache Spark - Structured Streaming
Data Engineering & Integration - Apache Airflow - DBT

Your next step

Complete your application on jobs.lever.co. The employer’s form will show what is required.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 8% over the last 5 weeks compared with the 5 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of October 26. The fewest in a week was 839, the most 1,314, and the latest week had 1,086.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 5 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Job description

View original posting ↗

Data Specialist

Primary Skills

    Databricks Engineer

    Role Overview

    We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will possess strong expertise in Databricks, PySpark, and SQL, with hands-on experience building batch and real-time data pipelines, implementing Lakehouse architectures, and ensuring data governance and performance optimization.

    Key Responsibilities

  • Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark.
  • Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers.
  • Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features.
  • Create, monitor, and optimize Delta Live Tables (DLT) pipelines.
  • Implement scalable and efficient data ingestion processes using Auto Loader.
  • Develop and manage real-time data processing solutions using Structured Streaming.
  • Orchestrate, schedule, and monitor data workflows using Databricks Workflows.
  • Design and implement Lakehouse data models to support reporting, analytics, and business intelligence requirements.
  • Establish and enforce data governance, security, and access controls using Unity Catalog.
  • Optimize Spark jobs, SQL queries, and overall platform performance to ensure efficiency and scalability.
  • Collaborate with cross-functional teams, including data analysts, architects, and business stakeholders, to deliver high-quality data solutions.
  • Required Skills (Must Have)

  • Databricks Platform
  • Delta Lake
  • Delta Live Tables (DLT)
  • Unity Catalog
  • Databricks Workflows
  • PySpark and Apache Spark
  • Structured Streaming
  • Auto Loader
  • SQL
  • Lakehouse Data Modeling
  • Strong understanding of data engineering best practices and scalable data architectures
  • Preferred Skills (Good to Have)

    Azure Ecosystem

  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Microsoft Purview
  • Microsoft Fabric
  • AWS Ecosystem

  • AWS Glue
  • AWS Lambda
  • AWS Step Functions
  • Data Engineering & Integration

  • Apache Airflow
  • DBT
  • Fivetran
  • Informatica
  • Streaming & Analytics

  • Apache Kafka
  • Power BI
  • Data Governance

  • Collibra
  • Alation
  • GCP

  • BigQuery
  • Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related discipline.
  • Proven experience in designing and implementing cloud-based data engineering solutions and scalable data pipelines.
  • Strong analytical, troubleshooting, and problem-solving capabilities.
  • Experience working in agile and collaborative environments.
  • Excellent communication and stakeholder management skills.
  • Preferred Candidate Profile

  • Hands-on experience with modern Lakehouse architectures and enterprise-scale data platforms.
  • Strong understanding of data governance, security, and compliance frameworks.
  • Experience delivering both batch and real-time data processing solutions.
  • Ability to work independently while collaborating effectively across global teams.
  • Key Technologies

    Databricks | PySpark | Apache Spark | Delta Lake | Delta Live Tables (DLT) | Unity Catalog | Structured Streaming | Auto Loader | SQL | Lakehouse Architecture | Azure | AWS | Airflow | Kafka | Power BI

Specialization

  • Databricks Engineering: Lead Data Engineer

Job requirements

    Databricks Engineer

    Role Overview

    We are seeking a highly skilled Databricks Engineer to design, develop, and optimize scalable data engineering and analytics solutions on the Databricks Lakehouse Platform. The ideal candidate will possess strong expertise in Databricks, PySpark, and SQL, with hands-on experience building batch and real-time data pipelines, implementing Lakehouse architectures, and ensuring data governance and performance optimization.

    Key Responsibilities

  • Design, develop, and maintain end-to-end data pipelines using Databricks and PySpark.
  • Build and implement Lakehouse architectures utilizing Bronze, Silver, and Gold data layers.
  • Develop and manage Delta Lake solutions with ACID transactions, schema enforcement, and data reliability features.
  • Create, monitor, and optimize Delta Live Tables (DLT) pipelines.
  • Implement scalable and efficient data ingestion processes using Auto Loader.
  • Develop and manage real-time data processing solutions using Structured Streaming.
  • Orchestrate, schedule, and monitor data workflows using Databricks Workflows.
  • Design and implement Lakehouse data models to support reporting, analytics, and business intelligence requirements.
  • Establish and enforce data governance, security, and access controls using Unity Catalog.
  • Optimize Spark jobs, SQL queries, and overall platform performance to ensure efficiency and scalability.
  • Collaborate with cross-functional teams, including data analysts, architects, and business stakeholders, to deliver high-quality data solutions.
  • Required Skills (Must Have)

  • Databricks Platform
  • Delta Lake
  • Delta Live Tables (DLT)
  • Unity Catalog
  • Databricks Workflows
  • PySpark and Apache Spark
  • Structured Streaming
  • Auto Loader
  • SQL
  • Lakehouse Data Modeling
  • Strong understanding of data engineering best practices and scalable data architectures
  • Preferred Skills (Good to Have)

    Azure Ecosystem

  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
  • Microsoft Purview
  • Microsoft Fabric
  • AWS Ecosystem

  • AWS Glue
  • AWS Lambda
  • AWS Step Functions
  • Data Engineering & Integration

  • Apache Airflow
  • DBT
  • Fivetran
  • Informatica
  • Streaming & Analytics

  • Apache Kafka
  • Power BI
  • Data Governance

  • Collibra
  • Alation
  • GCP

  • BigQuery
  • Qualifications

  • Bachelor's or Master's degree in Computer Science, Data Engineering, Information Technology, or a related discipline.
  • Proven experience in designing and implementing cloud-based data engineering solutions and scalable data pipelines.
  • Strong analytical, troubleshooting, and problem-solving capabilities.
  • Experience working in agile and collaborative environments.
  • Excellent communication and stakeholder management skills.
  • Preferred Candidate Profile

  • Hands-on experience with modern Lakehouse architectures and enterprise-scale data platforms.
  • Strong understanding of data governance, security, and compliance frameworks.
  • Experience delivering both batch and real-time data processing solutions.
  • Ability to work independently while collaborating effectively across global teams.
  • Key Technologies

    Databricks | PySpark | Apache Spark | Delta Lake | Delta Live Tables (DLT) | Unity Catalog | Structured Streaming | Auto Loader | SQL | Lakehouse Architecture | Azure | AWS | Airflow | Kafka | Power BI

Employment type

Employee

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Bangalore, Karnataka, India

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.