Back to jobs

Principal Data Engineer (PySpark, AI)

Bengaluru, KA, IN; Bengaluru, KA, IN

Actively hiring, first seen by us 10 hours ago
Pay
INR 3,486,000–5,478,000/year · BaseLocation-specific pay — pay source
Salary transparency Salary is one part of Autodesk’s competitive compensation package. For India based roles, we expect a starting base salary between 3,486,000 INR and 5,478,000 INR Annual. Offers are based on the candidate’s experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package. Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/global-belonging
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Define and drive architecture for scalable data platforms processing billions of records

  • Lead design and optimization of large-scale Spark, PySpark, Python and SQL pipelines

  • Modernize platforms with incremental processing and lakehouse architectures

  • Apply AI tools to improve engineering productivity and pipeline operations

  • Mentor engineers and lead technical design discussions across teams

From the employer’s posting
Define and drive the architecture of scalable, reliable, and cost-efficient data platforms processing billions of records.
Lead the design, development, and optimization of large-scale data pipelines using Spark, PySpark, Python, and SQL.
Drive platform modernization initiatives, including incremental processing, reusable frameworks, and modern data lakehouse architectures.
Leverage AI/GenAI technologies and AI-assisted development tools to improve engineering productivity, automate workflows, enhance data quality, and optimize pipeline operations.
Lead technical design discussions, influence architectural decisions, and mentor engineers across teams.

About Autodesk

We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

In the employer’s words · Read in context

Apply at Autodesk

Posting record

Report an error

Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 22, 2026today
Recorded sightings
1
Employer says posted
Nov 16, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

More Data Engineer jobs in Bengaluru

All Data Engineer jobs in Bengaluru →

How this job compares

Time since we first saw it

Day 0

Early. Similar jobs usually come down between day 6 and day 56.

From 14,772 similar postings that came down. Coming down is not always a hire.

Autodesk is hiring

10 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Hive
  • Iceberg
  • Looker
  • Power BI
  • Snowflake
  • Spark
  • Airflow
  • PySpark
Where the posting names them
Responsibilities * Define and drive the architecture of scalable, reliable, and cost-efficient data platforms processing billions of records. * Lead the design, development, and optimization of large-scale data pipelines using Spark, PySpark, Python, and SQL. * Drive platform modernization initiatives, including incremental processing, reusable frameworks, and modern data lakehouse architectures. * Leverage AI/GenAI technologies and AI-assisted development tools to improve engineering productivity, automate workflows, enhance data quality, and optimize pipeline operations. * Identify and resolve complex performance, scalability, reliability, and data quality challenges. * Establish engineering best practices for CI/CD, automated testing, observability, and cloud infrastructure. * Lead technical design discussions, influence architectural decisions, and mentor engineers across teams. * Collaborate with product managers, data scientists, and business stakeholders to translate business requirements into scalable data solutions. * Take end-to-end technical ownership of complex, cross-team engineering initiatives. Minimum Qualifications
Minimum Qualifications * 10+ years of experience in data engineering, distributed systems, or large-scale data processing. * Strong hands-on expertise in Apache Spark, PySpark, Python, Spark SQL, and SQL, including performance tuning and optimization. * Proven experience architecting and scaling complex data pipelines and distributed data processing systems. * Strong knowledge of AWS, Hive, Snowflake, and modern data lakehouse architectures. * Experience with data modeling, ETL/ELT frameworks, orchestration tools (such as Airflow), and CI/CD practices. * Hands-on experience with AI/GenAI technologies, including LLMs, prompt engineering, and AI-assisted development tools such as GitHub Copilot, Cursor, or equivalent. * Practical experience applying AI to data engineering workflows, such as code generation, automated testing, data quality validation, anomaly detection, pipeline optimization, or intelligent troubleshooting. * Strong understanding of data quality, observability, reliability, and cloud infrastructure. * Demonstrated technical leadership, architectural decision-making, and mentoring experience. * Excellent problem-solving, communication, and cross-functional collaboration skills. * Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience. Preferred Qualifications
Preferred Qualifications * Experience with Apache Iceberg, incremental data processing, and modern orchestration frameworks. * Experience modernizing legacy data platforms and optimizing large-scale Spark workloads. * Familiarity with BI tools such as Power BI or Looker. * Experience with AI agents or LLM-powered automation. * Experience building reusable data engineering frameworks and driving engineering standards across teams. #LI-SJ1

Your next step

Complete your application on jobs.autodesk.com. The employer’s form will show what is required.

Applying through Eightfold

  • You sign in, with Microsoft, LinkedIn, Google, Facebook or a new account, before the application opens.

Already applied? Track this application

Job description

View original posting ↗

Job Requisition ID # 26WD101628 Position Overview Autodesk is looking for a highly skilled Principal Data Engineer to join our Advanced Compliance Products (ACP) team. ACP is a strategic initiative focused on detecting non-compliant usage of Autodesk software through large-scale data processing and analytics. As a Principal Data Engineer, you will drive the technical architecture, scalability, and modernization of ACP's data engineering platform, leveraging modern cloud technologies and AI-driven engineering practices. You will solve complex engineering challenges, establish best practices, and lead cross-functional technical initiatives while remaining hands-on. Responsibilities * Define and drive the architecture of scalable, reliable, and cost-efficient data platforms processing billions of records. * Lead the design, development, and optimization of large-scale data pipelines using Spark, PySpark, Python, and SQL. * Drive platform modernization initiatives, including incremental processing, reusable frameworks, and modern data lakehouse architectures. * Leverage AI/GenAI technologies and AI-assisted development tools to improve engineering productivity, automate workflows, enhance data quality, and optimize pipeline operations. * Identify and resolve complex performance, scalability, reliability, and data quality challenges. * Establish engineering best practices for CI/CD, automated testing, observability, and cloud infrastructure. * Lead technical design discussions, influence architectural decisions, and mentor engineers across teams. * Collaborate with product managers, data scientists, and business stakeholders to translate business requirements into scalable data solutions. * Take end-to-end technical ownership of complex, cross-team engineering initiatives. Minimum Qualifications * 10+ years of experience in data engineering, distributed systems, or large-scale data processing. * Strong hands-on expertise in Apache Spark, PySpark, Python, Spark SQL, and SQL, including performance tuning and optimization. * Proven experience architecting and scaling complex data pipelines and distributed data processing systems. * Strong knowledge of AWS, Hive, Snowflake, and modern data lakehouse architectures. * Experience with data modeling, ETL/ELT frameworks, orchestration tools (such as Airflow), and CI/CD practices. * Hands-on experience with AI/GenAI technologies, including LLMs, prompt engineering, and AI-assisted development tools such as GitHub Copilot, Cursor, or equivalent. * Practical experience applying AI to data engineering workflows, such as code generation, automated testing, data quality validation, anomaly detection, pipeline optimization, or intelligent troubleshooting. * Strong understanding of data quality, observability, reliability, and cloud infrastructure. * Demonstrated technical leadership, architectural decision-making, and mentoring experience. * Excellent problem-solving, communication, and cross-functional collaboration skills. * Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience. Preferred Qualifications * Experience with Apache Iceberg, incremental data processing, and modern orchestration frameworks. * Experience modernizing legacy data platforms and optimizing large-scale Spark workloads. * Familiarity with BI tools such as Power BI or Looker. * Experience with AI agents or LLM-powered automation. * Experience building reusable data engineering frameworks and driving engineering standards across teams. #LI-SJ1 Learn More About Autodesk Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made. We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world. When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us! Salary transparency Salary is one part of Autodesk’s competitive compensation package. For India based roles, we expect a starting base salary between 3,486,000 INR and 5,478,000 INR Annual. Offers are based on the candidate’s experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package. Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/global-belonging In-Person Onboarding and Identity Verification This role may require in-person onboarding and/or in-person ID verification.

About Autodesk

People
About 14,300 in 2026, down 7% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ADSK.
H-1B visas
75 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Layoff notices
Notices this year and last cover 104 people. The latest was filed January 23, 2026.State WARN notices

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Salary transparency Salary is one part of Autodesk’s competitive compensation package. For India based roles, we expect a starting base salary between 3,486,000 INR and 5,478,000 INR Annual. Offers are based on the candidate’s experience and geographic location, and may exceed this range. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package. Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/global-belonging
Location & working pattern

Bengaluru, KA, IN; Bengaluru, KA, IN

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.