Time since we first saw it
Day 186
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
As an early data engineer at Viaduct, an analytics and ML platform company, your work is critical to our success.
Create and support batch, incremental, and real-time ETL pipelines
Standardize ingestion, validation, and cleaning processes across clients
Automate data validation to improve data quality
Manage and evolve schemas across the pipeline
Monitor, tune, and optimize Spark jobs
As an early data engineer at Viaduct, an analytics and ML platform company, your work is critical to our success. You are responsible for ensuring data quality and reliability in every part of our ETL pipeline, from ingestion to client integrations.
Creating and supporting batch, incremental, and real-time ETL pipelines
Standardizing ingestion, validation, and cleaning processes across clients
Automating data validation to increase data quality
Managing and evolving schemas in all parts of our pipeline
Monitoring, tuning, and optimizing Spark jobs
3+ years as a data engineer
3+ years of experience with Spark or equivalent technologies
Proficiency in Python/Scala/Java/C++ and SQL
2+ years of experience with a workflow scheduler (Airflow, Prefect, Argo, etc)
2+ years of experience with distributed file-systems (HDFS, S3, etc)
We are a diverse and focused team motivated to solve the hardest problems in the automotive industry through machine learning.
In the employer’s words · Read in context
Open 6 monthsWe first saw this posting 186 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 186
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
5 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Experience as a tech lead or mentor - Proficiency in Python/Scala/Java/C++ and SQL - 3+ years of experience with Spark or equivalent technologies
- Familiar with the tools in open-source data ecosystem (Apache, CNCF, etc) - Experience with incremental or real-time processing (Delta Lake, Apache Hudi, Kafka Stream, Spark Streaming, etc) Security and Privacy Responsibilities
- 2+ years of experience with a workflow scheduler (Airflow, Prefect, Argo, etc) - 2+ years of experience with distributed file-systems (HDFS, S3, etc) - Familiar with the tools in open-source data ecosystem (Apache, CNCF, etc)
Bonus - Experience with Kubernetes - Experience working with ML teams
- Managing and evolving schemas in all parts of our pipeline - Monitoring, tuning, and optimizing Spark jobs - Becoming a domain-expert in connected vehicle data
- Proficiency in Python/Scala/Java/C++ and SQL - 3+ years of experience with Spark or equivalent technologies - 2+ years of experience with a workflow scheduler (Airflow, Prefect, Argo, etc)
- 3+ years of experience with Spark or equivalent technologies - 2+ years of experience with a workflow scheduler (Airflow, Prefect, Argo, etc) - 2+ years of experience with distributed file-systems (HDFS, S3, etc)
Complete your application on www.viaduct.ai. The employer’s form will show what is required.
Already applied? Track this application
Yes. We’ve followed one other Data Engineer job there since October 2026. It is still up.
We are a diverse and focused team motivated to solve the hardest problems in the automotive industry through machine learning. We have developed an end-to-end machine learning platform to empower automakers to build safer, smarter, and personalized vehicles. Our platform increases connected vehicle data accessibility and actionability for automakers, their partners and their end-customers.
You are a thoughtful engineer. You understand the complexities of distributed systems and how to triage and solve issues that arise with them. Scalability is top of mind when designing any system or writing code. You believe building a better ETL system requires close collaboration with the machine learning and data science teams.
As an early data engineer at Viaduct, an analytics and ML platform company, your work is critical to our success. You are responsible for ensuring data quality and reliability in every part of our ETL pipeline, from ingestion to client integrations.
Responsibilities
About You
Security and Privacy Responsibilities
Bonus
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Slovenia
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.