Time since we first saw it
Day 170
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
Barcelona, Spain
Open 5 months, first seen by us 170 days agoEmployment type in the employer’s posting: Full-Time (40h)From the employer’s posting
Lead data architecture design and implementation decisions
Manage ETL and data workflows in Airflow
Build and run data lake and warehouse on AWS S3 and Redshift
Consume and process queue-based data from message brokers
leading the design and implementation decisions of our data pipelines
Experience managing ETL or similar Data Workflows
We are building our new data lake and data warehouse directly in AWS S3
We have multiple queue systems from which we consume data
valid work permit
Experience in leading data architecture decisions and similar responsibilities.
Experience managing ETL or similar Data Workflows
A valid work permit to be employed in Spain.
Open 5 monthsWe first saw this posting 170 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 170
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
4 open jobs
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Extremely skilled programmer (e.g., unittest, production/staging experience). - Python proficiency, and ideally experience with other programming languages such as Java, Scala. - Strong knowledge of different data storages (knows pros and cons, understand and investigate the best solution for each use-case).
- We have multiple queue systems from which we consume data coming from the Jobandtalent Message brokers while filling up our data storage. - We use Airflow as our ETL which allows us to break down any complex problem/process into smaller ones. Each component can be implemented directly in Python, or any other language since we could execute any docker container in AWS Fargate. - We are integrating different 3rd party data (Kustomer, Salesforce, etc.). We keep iterating in the best way to incorporate this data into our Datalake which allows our users to exploit this data.
The Data Team is very independent of the rest of the Tech and Product teams. We build and manage our services that run our AI models as well as our data storages to quickly process the data we need, and let the Data Scientist performing the “Time Travel” to properly train our algorithms. A quick insight about our architecture and tools: - We are building our new data lake and data warehouse directly in AWS S3, synchronizing the data via DMS, and consolidate it via Hudi. This data will be accessible by multiple Redshift clusters via Spectrum that allows us to quickly scale up across all the countries. In addition, as data is stored in S3 this could be exploited via Athena or an ad-hoc Spark job. - We have multiple queue systems from which we consume data coming from the Jobandtalent Message brokers while filling up our data storage.
- Experience in leading data architecture decisions and similar responsibilities. - Previous practical experience with Big Data technologies knowledge, batch and real-time (Hadoop, Spark, Hudi, Spark Streaming, Flink, etc.). - Extensive experience with production-ready code (not scripting code).
- Strong knowledge of different storage formats (JSON, Parquet, Avro, etc.), understand and investigate the best solution for each use-case. - Streaming data queue platforms knowledge (Kinesis, Kafka, RabbitMQ, etc.). - Excellent verbal and written communication skills; ability to communicate effectively with different levels of management, as well as the business and technical communities.
Complete your application on jobandtalent.bamboohr.com. The employer’s form will show what is required.
Already applied? Track this application
Jobandtalent
You will be the main referent of our data architecture, leading the design and implementation decisions of our data pipelines.
The Data Team is very independent of the rest of the Tech and Product teams. We build and manage our services that run our AI models as well as our data storages to quickly process the data we need, and let the Data Scientist performing the “Time Travel” to properly train our algorithms. A quick insight about our architecture and tools:
You need to have proven experience in these areas, being eager to learn and improve, while enjoying taking responsibility. You need to be very hands-on, able to explore different solutions to our problems and needs.
Requirements and Skills
Besides, we are looking for a senior profile that will be interested in:
Offer in Short
You will be working in the Data Science team (read the last blog posts), together with Full-stack Engineers, Data Scientists, and Data Analysts.
Q&A
How the Jobandtalent Engineering team is structured?
How the Jobandtalent Data team is organized?
How do we organize the tasks and the planning?
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Barcelona, Spain
- Great Challenges for the Data Team: Integrating very different AI solutions to improve the experience for both our workers and employers (Shift Optimization, Machine Learning algorithms, Quality Score Estimations, Document recognition, etc.), relying on a very powerful ETL that permits endless automatizations while keeping the focus on data quality. - Growth Overview: An annual growth of 170%, available in multiple countries: the UK, Spain, Germany, Sweden, Mexico, Colombia, France, and more are coming. HQ in Madrid with a second big presence in Barcelona and some remote workers in the UK, The Netherlands, and the USA. And finally, some of our great clients are Amazon, XPOLogistics, Cabify, Santander, Just Eat, etc. You will be the main referent of our data architecture, leading the design and implementation decisions of our data pipelines.
- Excellent verbal and written communication skills; ability to communicate effectively with different levels of management, as well as the business and technical communities. - A valid work permit to be employed in Spain. - Fluent in English is a must.