Back to jobs

Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Design, build and manage data pipelines into the Databricks data lake

  • Own the dbt layer: models, sources, tests, macros and documentation

  • Turn raw data into well-modeled, trusted assets for downstream teams

  • Keep clean, validated data ready for AI and ML models

  • Find and fix performance bottlenecks in dbt models and Databricks queries

From the employer’s posting
Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake
Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation
Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust
Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it
Identify and fix performance bottlenecks in dbt models, Databricks queries and downstream reporting pipelines

About Prodigal

Prodigal is the connected AI platform leading financial institutions use to run their operations.

In the employer’s words · Read in context

Apply at Prodigal

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 3, 202679 days ago
Recorded sightings
48
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 79

Up longer than most. Similar jobs usually come down between day 6 and day 56.

From 14,767 similar postings that came down. Coming down is not always a hire.

Prodigal is hiring

5 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Databricks
  • dbt
  • MongoDB
  • PostgreSQL
  • Redis
  • S3
  • Spark
  • Airflow
  • PySpark
Where the posting names them
- Strong SQL - you can write and reason about complex joins, aggregations and window functions, and you know why a query is slow before you tune it - Python for data engineering with production-grade PySpark or Spark SQL experience. Databricks strongly preferred - Dimensional modeling - star schemas, fact vs dimension grain, SCD Type 2, and incremental loads you can confidently re-run without breaking things
⚙️ Our Tech Stack - Products built using Python, Cursor, Claude, dbt, Airflow - Databases such as MongoDB, PostgreSQL, Redis, Databricks,
- 2-3 years of hands-on experience in data engineering - you've built things in production, not just in notebooks - Strong SQL - you can write and reason about complex joins, aggregations and window functions, and you know why a query is slow before you tune it - Python for data engineering with production-grade PySpark or Spark SQL experience. Databricks strongly preferred
- dbt as your transformation framework of choice - models, tests, sources and incremental strategies are second nature to you - AWS hands-on experience across Lambda, S3, CloudFront, SQS and beyond - AI-native workflow - we ship with Claude Code and Cursor and we expect you to use them well, not just know they exist
- Databases such as MongoDB, PostgreSQL, Redis, Databricks, - Deployments on EKS, EC2, Lambda and other AWS services 🎁 What we offer
🏆 Responsibilities - Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake - dbt is your primary tool, not an afterthought - Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation. If it touches transformation, it goes through dbt and you're accountable for it being clean, tested and re-runnable
- Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it - Identify and fix performance bottlenecks in dbt models, Databricks queries and downstream reporting pipelines ✅ Requirements
- Products built using Python, Cursor, Claude, dbt, Airflow - Databases such as MongoDB, PostgreSQL, Redis, Databricks, - Deployments on EKS, EC2, Lambda and other AWS services
- Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake - dbt is your primary tool, not an afterthought - Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation. If it touches transformation, it goes through dbt and you're accountable for it being clean, tested and re-runnable - Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust - no untested models, no undocumented logic, no shortcuts
- Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust - no untested models, no undocumented logic, no shortcuts - Collaborate closely with cross-functional teams to deliver actionable insights that drive product, AI and business decisions - translating business logic into dbt models that are built to last - Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it
- Dimensional modeling - star schemas, fact vs dimension grain, SCD Type 2, and incremental loads you can confidently re-run without breaking things - dbt as your transformation framework of choice - models, tests, sources and incremental strategies are second nature to you - AWS hands-on experience across Lambda, S3, CloudFront, SQS and beyond

Your next step

Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.

Applying through Greenhouse

  • No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
  • Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.

Already applied? Track this application

Job description

View original posting ↗

About Prodigal

Prodigal is the connected AI platform leading financial institutions use to run their operations.

We work with banks, lenders, credit unions, and other financial companies that lend money to people and manage those relationships over time.

These institutions make millions of high-stakes decisions every day. Who should they reach? When should they reach them? What should they say or offer? When should a case move to a human? How should that change based on the borrower, the account, previous interactions, and the regulations involved?

Getting those decisions right requires a deep understanding of the people, processes, rules, and edge cases behind them.

Prodigal has spent the last eight years building that understanding. More than a billion interactions between financial institutions and their customers have shaped the intelligence, guardrails, and AI agents we now run in production across North America.

Today, our AI agents analyze conversations, capture context, guide human agents, decide the next action, conduct customer conversations, orchestrate outreach, and help people complete payments and resolutions. They are connected, so what is learned in one interaction can inform what happens next.

We are expanding this swarm of AI agents across more of the work financial institutions do: originations, document processing, back-office workflows, servicing, and other critical operations where money, identity, people, and regulation intersect.

We are backed by Y Combinator, Accel, and Menlo Ventures, and work with 100+ financial institutions across North America. Listen directly from our CTO, Cofounder - Sangram Raje

About the role - 

We are looking for a passionate and driven Data Engineer to join our team. You will be instrumental in building scalable data pipelines, generating powerful insights, and supporting our AI/ML initiatives. If you enjoy working across data engineering and analytics and want to help shape the future of Agentic AI, we'd love to hear from you!

🏆 Responsibilities

  • Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake - dbt is your primary tool, not an afterthought
  • Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation. If it touches transformation, it goes through dbt and you're accountable for it being clean, tested and re-runnable
  • Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust - no untested models, no undocumented logic, no shortcuts
  • Collaborate closely with cross-functional teams to deliver actionable insights that drive product, AI and business decisions - translating business logic into dbt models that are built to last
  • Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it
  • Identify and fix performance bottlenecks in dbt models, Databricks queries and downstream reporting pipelines

✅ Requirements 

  • 2-3 years of hands-on experience in data engineering - you've built things in production, not just in notebooks
  • Strong SQL - you can write and reason about complex joins, aggregations and window functions, and you know why a query is slow before you tune it
  • Python for data engineering with production-grade PySpark or Spark SQL experience. Databricks strongly preferred
  • Dimensional modeling - star schemas, fact vs dimension grain, SCD Type 2, and incremental loads you can confidently re-run without breaking things
  • dbt as your transformation framework of choice - models, tests, sources and incremental strategies are second nature to you
  • AWS hands-on experience across Lambda, S3, CloudFront, SQS and beyond
  • AI-native workflow - we ship with Claude Code and Cursor and we expect you to use them well, not just know they exist
  • Sharp problem solving - you find the right balance between getting it right and getting it done, and communicate clearly when tradeoffs are being made
  • Self-driven and curious - you thrive in fast paced environments, pick things up quickly and keep an eye on what's emerging in the data ecosystem
  • Bonus - Foundational knowledge in ML/AI fundamentals

 

 

Mode of Work - In-Office (Koramangala,Bengaluru)

⚙️ Our Tech Stack

  • Products built using Python, Cursor, Claude, dbt, Airflow
  • Databases such as MongoDB, PostgreSQL, Redis, Databricks, 
  • Deployments on EKS, EC2, Lambda and other AWS services

🎁 What we offer

Top Tier Benefits 

Health insurance for you and your family, meals at office on us, travel reimbursement, unlimited leaves, subsidized gym membership, unlimited learning & development, flexible work schedule and a world-class team to learn and grow with! 

From day 1, Prodigal has been defined by talented, humble, and hungry leaders and we want this mindset and culture to continue to blossom from top to bottom in the company. If you have an entrepreneurial spirit and want to work in a fast-paced, intellectually-stimulating environment where you will be pushed to grow, then please reach out because we are looking to build a transformational company that reinvents one of the biggest industries in the US.

To learn more about us - please visit the following:

Our Story - https://www.prodigaltech.com/our-story

What shapes our thinking - https://link.prodigaltech.com/our-thesis

Our website - https://www.prodigaltech.com/ 

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Bengaluru

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.