Develop and implement automated pipelines for ingesting, processing and storing data
Integrate data from many sources in real-time and batch, and transform it for accuracy
Implement data quality checks and pipeline monitoring to catch issues early
Write Python, Java or Scala code and scripts to automate data processes
Optimize data processes for efficiency and scalability
From the employer’s posting
Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data.
Integrate data from various sources in both real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability.
Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
Continuously optimize data processes for efficiency and scalability.
Open 4 monthsWe first saw this posting 135 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
Status in our records
Live
First seen by us
Jul 9, 2026135 days ago
Recorded sightings
258
Last seen by us
Nov 15, 2026
Employer says posted
Dec 10, 2025
Jul 9, 2026today
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
How this job compares
Time since we first saw it
Day 135
656
Up longer than most. Similar jobs usually come down between day 6 and day 56.
Well past Arrow Electronics’s usual: its jobs come down by about day 58.
From 14,767 similar postings that came down, and 24 of Arrow Electronics’s. Coming down is not always a hire.
Arrow Electronics is hiring
7 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Java
Python
Scala
AWS
Azure
GCP
Spark
Airflow
Luigi
Where the posting names them
- Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
- Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
- Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
- Strong understanding of data pipelines and data lifecycle management.
- Proficiency in scripting languages like Python, Shell, or similar.
- Experience with data automation tools (Airflow, Luigi, etc.) a plus.
- Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
- Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
- Collaborate with other intelligent data teams.
- Strong communication and collaboration skills to work effectively across teams.
- Knowledge with cloud platforms (AWS, Azure, GCP) for data processing.
Knowledge of data warehousing and data quality methodologies
- Proficiency in scripting languages like Python, Shell, or similar.
- Experience with data automation tools (Airflow, Luigi, etc.) a plus.
- Excellent analytical and problem-solving skills.
Complete your application on arrow.wd1.myworkdayjobs.com. The employer’s form will show what is required.
Applying through Workday
You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
“Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
Your application status lives in that employer’s Candidate Home, under the same sign-in.
As a Data Automation Engineer, you will play a crucial role in developing and maintaining automated data processing systems. You will work closely with data analysts, and other stakeholders to design, implement, and optimize data pipelines, ensuring the efficient and accurate flow of data throughout the organization.
What You'll Do:
Develop and implement automated data pipelines for ingesting, processing, and storing structured and unstructured data.
Integrate data from various sources in both real-time and batch mechanisms and perform transformations to ensure consistency, accuracy, and reliability.
Implement data quality checks and monitoring mechanisms to identify and address issues proactively.
Write code and scripts for automation of data processes using languages such as Python, Java, or Scala.
Leverage ETL (Extract, Transform, Load) tools and frameworks [Apache spark, AWS Glue] for efficient data processing.
Collaborate with other intelligent data teams.
Ensure seamless data flow for machine learning and analytics applications.
Implement monitoring systems to track data pipeline performance and identify areas for optimization.
Continuously optimize data processes for efficiency and scalability.
Document data processes, system architecture, and codebase for knowledge sharing and future reference.
Keep documentation up-to-date with any changes or enhancements to the data infrastructure.
Implement and adhere to data security and compliance standards.
Collaborate with security teams to ensure data protection and privacy.
You're a Perfect Fit If You Have:
1+ years of experience in data engineering, automation, or a related field.
Strong understanding of data pipelines and data lifecycle management.
Proficiency in scripting languages like Python, Shell, or similar.
Experience with data automation tools (Airflow, Luigi, etc.) a plus.
Excellent analytical and problem-solving skills.
Strong communication and collaboration skills to work effectively across teams.
Knowledge with cloud platforms (AWS, Azure, GCP) for data processing.
Knowledge of data warehousing and data quality methodologies
About 22,230 in 2025, up 3% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ARW.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.