Time since we first saw it
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 14,166 similar postings that came down. Coming down is not always a hire.
London, England, United Kingdom
Actively hiring, first seen by us 12 hours agoState-of-the-art equipment (mac, iPhone, and mobile plan) Flexible WFH (Hybrid Model) - Fully Remote is also an option if you're not an Attica resident Our benefits package is designed to provide strong support to our team, but it may vary depending on location and type of employment (e.g., UK, Greece, or engagement through an Employer of Record).
Work setup in the employer’s posting: RemoteFrom the employer’s posting
Employment type in the employer’s posting: Full-timeFrom the employer’s posting
You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.
You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed.
✨The core mission of the Senior Data Engineer: You will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products. Your day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code.
You will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products. Your day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code. 🏢 Location & Work Mode:
We believe that diversity enriches our performance, services, and the communities we serve.
In the employer’s words · Read in context
Actively hiringFirst seen by us today, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 14,166 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Analytical store: ClickHouse - Languages: Python, SQL - Modelling & quality: dbt, data quality gates
- Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub - Solid SQL and strong Python — you write production-quality code, not just notebooks - Experience with ClickHouse or another columnar OLAP engine in production
You will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products. Your day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code. 🏢 Location & Work Mode:
⚔️ Technology tools & weapons you’ll be using: - Cloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage - Streaming & messaging: Pub/Sub, Kafka
🚀 The adventures that await you after becoming Senior Data Engineer at Hack The Box: - Design and build batch and streaming pipelines on Dataflow, Pub/Sub, and Kafka feeding BigQuery, Bigtable, and ClickHouse - Help drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way
- Strong data modelling and warehouse architecture skills (dimensional modelling, event-driven, lakehouse patterns) - Hands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses - Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub
- Orchestration: Airflow (Cloud Composer) - Analytical store: ClickHouse - Languages: Python, SQL
- Solid SQL and strong Python — you write production-quality code, not just notebooks - Experience with ClickHouse or another columnar OLAP engine in production - Workflow orchestration experience with Airflow (or Prefect/Dagster)
- Languages: Python, SQL - Modelling & quality: dbt, data quality gates - Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent
- Workflow orchestration experience with Airflow (or Prefect/Dagster) - Comfortable with dbt or equivalent transformation frameworks - Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus
- Modelling & quality: dbt, data quality gates - Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent - Legacy (being retired): Snowflake
- Working knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining - Docker & Kubernetes experience - CI/CD mindset, infrastructure-as-code sensibility, and a bias for simple, observable systems
- Cloud & warehouse: GCP, BigQuery, Bigtable, Cloud Storage - Streaming & messaging: Pub/Sub, Kafka - Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate
- Hands-on experience with GCP data services — BigQuery is a must; Pub/Sub, Dataflow, Bigtable, Cloud Composer are strong pluses - Production experience with streaming pipelines on Dataflow/Beam, Flink, or Spark Structured Streaming, ingesting from Kafka and/or Pub/Sub - Solid SQL and strong Python — you write production-quality code, not just notebooks
- Experience with ClickHouse or another columnar OLAP engine in production - Workflow orchestration experience with Airflow (or Prefect/Dagster) - Comfortable with dbt or equivalent transformation frameworks
- Comfortable with dbt or equivalent transformation frameworks - Experience migrating off legacy warehouses (Snowflake, Redshift, Synapse) onto cloud-native stacks is a plus - Working knowledge of ML in production — feature engineering, feature stores, model deployment, drift monitoring, retraining
- Containers & CI/CD: Docker, Kubernetes, GitHub Actions / equivalent - Legacy (being retired): Snowflake 🚀 The adventures that await you after becoming Senior Data Engineer at Hack The Box:
- Design and build batch and streaming pipelines on Dataflow, Pub/Sub, and Kafka feeding BigQuery, Bigtable, and ClickHouse - Help drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way - Own the orchestration layer in Airflow, including SLAs, retries, and data quality gates
- Processing: Dataflow (Apache Beam), with Flink/Spark where appropriate - Orchestration: Airflow (Cloud Composer) - Analytical store: ClickHouse
- Help drive the migration off Snowflake onto our GCP-native stack — and retire shadow pipelines along the way - Own the orchestration layer in Airflow, including SLAs, retries, and data quality gates - Model data for analytics and for ML — including feature pipelines that serve both training and low-latency online inference
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
Welcome! Super excited you dropped by 🥳
Let's redefine cyber security expertise standards and connect business - community through highly engaging hacking experiences. (Find out more insights about Hack The Box culture in our career site).
You will own and evolve our data pipelines on GCP — building new ones, hardening existing ones, improving data quality, and making clean, trustworthy data available across the organisation. You'll work end-to-end on streaming and batch pipelines, from CDC and event ingestion through transformation, serving, and the feature layer that powers our ML and AI products.
Your day-to-day will include designing ELT/ETL processes on BigQuery and ClickHouse, building real-time pipelines on Pub/Sub and Kafka with Dataflow (and where it fits, Flink/Spark), orchestrating workflows with Airflow, and ensuring data is properly cleaned, modelled, and served for analytics, ML training, and online inference. You'll partner with ML engineers on feature pipelines, monitoring data drift, and keeping models well-fed and retrained as needed. You'll consume and build REST APIs, integrate with third-party SaaS sources, and treat infrastructure as code.
🏢 Location & Work Mode:
Fully Remote / Hybrid (2 days in the office, 3 days remote, plus one month of work from anywhere) - If only in Greece: When hiring in Greece, we’re open to candidates from all locations. Those based within 55 km of our Athens office will follow a hybrid work model. For candidates located beyond that radius, a fully remote arrangement is available.
You will be part of the Data, Analytics & AI team, collaborating closely with Infrastructure, Software Engineering, Product, and ML/AI engineers. We're in the middle of a GCP-native modernisation — migrating away from Snowflake toward BigQuery, Bigtable, Pub/Sub, and Dataflow — so we're looking for someone who's opinionated about clean architecture, allergic to over-engineering, and comfortable owning systems end-to-end. If retiring a legacy warehouse and standing up its replacement sounds like a good time, you'll fit right in.
Our benefits package is designed to provide strong support to our team, but it may vary depending on location and type of employment (e.g., UK, Greece, or engagement through an Employer of Record).
Hack Your Career, Today. Join us in this epic adventure of cybersecurity at Hack The Box! 🚀🔒💻
At Hack The Box, we are on a quest to find the most exceptional and enthusiastic talent to join our team. Whether or not you consider yourself a gamer, we value what makes you unique and want to know more about you. This job post provides just a glimpse of the incredible gamified experience our business and consumer customers enjoy through our platforms. So, if you're ready to embark on a journey of growth and adventure, we can't wait to meet you!
Hack The Box is the Cyber Performance Center with the mission to provide a human-first platform to create and maintain high-performing cybersecurity individuals and organizations.
Hack The Box is the only platform that unites upskilling, workforce development, and the human focus in the cybersecurity industry, and it’s trusted by organizations worldwide for driving their teams to peak performance. Offering an all-in-one environment for continuous growth, assessment, and recruitment, Hack The Box provides solutions for all cybersecurity domains.
Launched in 2017, Hack The Box brings together the largest global cybersecurity community of more than 3 million platform members. Rapidly growing its international footprint and reach, Hack The Box is headquartered in the UK, with additional offices in the US, Australia, and Greece.
🚨 Exciting News:
At Hack The Box, we are committed to fostering a diverse, inclusive, and equitable workplace. We believe that diversity enriches our performance, services, and the communities we serve. As such, we ensure that all job applications are considered solely based on merit, skills, and qualifications. We do not discriminate on grounds of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. We are dedicated to providing a fair and respectful work environment that reflects our values.
New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
London, England, United Kingdom
- Europe/Greece - Choose between fully remote work across Europe or relocating to our Athens Tech Hub with relocation support. Fully Remote / Hybrid (2 days in the office, 3 days remote, plus one month of work from anywhere) - If only in Greece: When hiring in Greece, we’re open to candidates from all locations. Those based within 55 km of our Athens office will follow a hybrid work model. For candidates located beyond that radius, a fully remote arrangement is available. ✈️ Relocation
- State-of-the-art equipment (mac, iPhone, and mobile plan) - Flexible WFH (Hybrid Model) - Fully Remote is also an option if you're not an Attica resident Our benefits package is designed to provide strong support to our team, but it may vary depending on location and type of employment (e.g., UK, Greece, or engagement through an Employer of Record).
No clear work-authorization passage found. Eligibility is unconfirmed.