Bachelor's or Master's in Computer Science or Software Engineering
8+ years of experience
Proficient in Java and/or Python
Experience with SQL/NoSQL databases and big data tools like Hadoop, Hive
Familiarity with agentic AI concepts and Model Context Protocol (MCP)
Preferred experience
Experience with Cloud Platforms like AWS, GCP and Azure
Proficient in architect and designing batch processing and streaming data pipelines using Spark, Kafka
Excellent communication, analytical and problem solving skills
Qualification wording
Bachelor’s or Master’s Degree in Computer Science or Software Engineering
minimum of 8+ years of experience
Proficient in programming languages like Java And/or Python
Experience with Database Technologies (SQL/NoSQL) & Big Data Technologies (Hadoop, Hive)
Familiarity with agentic AI concepts such as tool usage, multi-step orchestration, and Model Context Protocol (MCP)
Experience with Cloud Platforms like AWS, GCP and Azure
Proficient in architect and designing batch processing and streaming data pipelines using Spark, Kafka
Excellent communication, analytical and problem solving skills
Education & alternatives
Required Qualifications
- Bachelor’s or Master’s Degree in Computer Science or Software Engineering with a minimum of 8+ years of experience.
- Proficient in computer science fundamentals, algorithms & data structures
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Java
Python
SQL
AWS
Azure
GCP
Hadoop
Hive
Kafka
Kubernetes
NoSQL
Spark
Where the posting names them
- Architect end-to-end solutions, lead teams by example and work with cross functional stakeholders to productise the solutions.
- Design, build and support platform for customer analytical needs using Java and/or Python as programming language
- Design, build and support batch processing and streaming data pipelines
- Proficient in computer science fundamentals, algorithms & data structures
- Proficient in programming languages like Java And/or Python
- Experience with Database Technologies (SQL/NoSQL) & Big Data Technologies (Hadoop, Hive)
- Design, develop, and support AI-enabled assistants, chatbots, and automation solutions
- Develop Python-based automation services, REST APIs, and backend integrations to connect AI/automation solutions with enterprise systems, including MCP-based tool integrations.
- Deploy and support applications on Kubernetes/Edge platforms, using GitOps and CI/CD pipelines
- Proficient in programming languages like Java And/or Python
- Experience with Database Technologies (SQL/NoSQL) & Big Data Technologies (Hadoop, Hive)
- Familiarity with agentic AI concepts such as tool usage, multi-step orchestration, and Model Context Protocol (MCP) for integrating AI systems with enterprise tools and services.
Preferred Qualifications
- Experience with Cloud Platforms like AWS, GCP and Azure
- Proficient in architect and designing batch processing and streaming data pipelines using Spark, Kafka
- Experience with Cloud Platforms like AWS, GCP and Azure
- Proficient in architect and designing batch processing and streaming data pipelines using Spark, Kafka
- Familiar with working in an agile software development framework with test driven development approaches
- Develop Python-based automation services, REST APIs, and backend integrations to connect AI/automation solutions with enterprise systems, including MCP-based tool integrations.
- Deploy and support applications on Kubernetes/Edge platforms, using GitOps and CI/CD pipelines
- Work with cross functional stakeholders to understand their requirements
About 40,000 in 2026, about the same as the year before.Annual report (SEC Form 10-K)
Company
Listed as WDC.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Architect end-to-end solutions, lead teams by example and work with cross functional stakeholders to productise the solutions.
Design, build and support platform for customer analytical needs using Java and/or Python as programming language
Design, build and support batch processing and streaming data pipelines
Design, develop, and support AI-enabled assistants, chatbots, and automation solutions
Develop Python-based automation services, REST APIs, and backend integrations to connect AI/automation solutions with enterprise systems, including MCP-based tool integrations.
Deploy and support applications on Kubernetes/Edge platforms, using GitOps and CI/CD pipelines
Work with cross functional stakeholders to understand their requirements
Guide team members overcome technical challenges
Qualifications
Required Qualifications
Bachelor’s or Master’s Degree in Computer Science or Software Engineering with a minimum of 8+ years of experience.
Proficient in computer science fundamentals, algorithms & data structures
Proficient in programming languages like Java And/or Python
Experience with Database Technologies (SQL/NoSQL) & Big Data Technologies (Hadoop, Hive)
Familiarity with agentic AI concepts such as tool usage, multi-step orchestration, and Model Context Protocol (MCP) for integrating AI systems with enterprise tools and services.
Preferred Qualifications
Experience with Cloud Platforms like AWS, GCP and Azure
Proficient in architect and designing batch processing and streaming data pipelines using Spark, Kafka
Familiar with working in an agile software development framework with test driven development approaches
Excellent communication, analytical and problem solving skills
Additional Information
WD thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.
WD is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at jobs.accommodations@wdc.com to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
Notice To Candidates: Please be aware that WD and its subsidiaries will never request payment as a condition for applying for a position or receiving an offer of employment. Should you encounter any such requests, please report it immediately to WD Ethics Helpline or email compliance@wdc.com.
Company Description
WD is building the infrastructure behind the AI-driven data economy.
As AI scales, so does data. Every interaction, every model, every system generates data that must be stored, managed, and made accessible over time. That’s where we come in.
We combine deep engineering expertise with global-scale manufacturing to deliver the storage systems that make AI possible, powering hyperscale data centers, cloud platforms, and enterprise infrastructure worldwide.
This isn’t theoretical work. It’s real systems, at real scale, people solving some of the hardest challenges in technology today.
We’re looking for people who want to build, solve, and operate at that level.