Time since we first saw it
Day 20
Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
Work setup in the employer’s posting: TELECOMMUTEFrom the employer’s posting
Monitor and troubleshoot production incidents on the data platform
Optimize PySpark workloads and Databricks jobs for cost and reliability
Support and improve about 200 existing Databricks jobs and pipelines
Design scaling strategies that keep infrastructure and operating costs predictable
Improve observability, monitoring, and alerting across regional deployments
Monitor the health, stability, and performance of the production data platform
Optimize PySpark workloads and Databricks jobs for performance, reliability, and cost efficiency
Support and improve approximately 200 existing Databricks jobs and associated data pipelines
Design and implement scaling strategies with a strong focus on predictable infrastructure and operational costs
Improve platform observability, monitoring, alerting, and operational processes
We are looking for an experienced Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at a significant scale, processing tens of terabytes of telemetry data in Azure Databricks and running approximately 200 Databricks jobs. The solution is currently in the production maintenance and evolution phase and is deployed across multiple regions, including Europe, North America, and China, with an additional deployment in China planned in the near future. A key focus of the role will be ensuring that the system can scale reliably while keeping infrastructure and operational costs predictable. Responsibilities Monitor the health, stability, and performance of the production data platform Investigate and resolve performance issues and production incidents Analyze Databricks workloads and identify performance bottlenecks Optimize PySpark workloads and Databricks jobs for performance, reliability, and cost efficiency Support and improve approximately 200 existing Databricks jobs and associated data pipelines Prepare the platform for increasing data volumes and workloads as additional vehicle platforms are onboarded Design and implement scaling strategies with a strong focus on predictable infrastructure and operational costs Track and optimize Databricks and Azure resource consumption Improve platform observability, monitoring, alerting, and operational processes Ensure consistency across multiple regional deployments in Europe, North America, and China Identify opportunities for technical improvements, automation, and reduction of operational overhead Requirements 3+ years of hands-on experience in data engineering Expertise in Azure Databricks Proficiency in PySpark and distributed data processing Advanced skills in Python development Understanding of performance optimization for large-scale Spark workloads Background in operating and troubleshooting production data platforms Knowledge of monitoring, observability, and capacity planning combined with cloud cost optimization Ability to analyze existing systems, identify bottlenecks, and propose pragmatic improvements English proficiency at an Upper-Intermediate level (B2) or higher Nice to have Familiarity with Microsoft Azure services and cloud infrastructure Experience building and maintaining CI/CD pipelines using GitHub Actions Exposure to large-scale telemetry, IoT, or automotive data Background in managing Databricks environments with a large number of scheduled jobs and pipelines Showcase of multi-region or geographically distributed cloud deployments
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 20
Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
892 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
Yes. We’ve followed 3 other Senior Data Engineer/ Databricks, PySpark, Python jobs there since November 2026. All 3 are still up.
Large employers often post one title for several teams, so these can be separate openings.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Location not supplied.
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting