Back to jobs

Senior DevOps Engineer | Data Platform

Remote oder Köln / Darmstadt / Düsseldorf / Berlin

Actively hiring, first seen by us 3 days ago
Pay
Pay not listed
Work setting
Remote — work setting source
Listed location: Remote oder Köln / Darmstadt / Düsseldorf / Berlin
Read the full posting
Employment
Permanent — employment source
Employment type in the employer’s posting: Festanstellung
From the employer’s posting

What you’ll work on

Full posting
  • Run and own self-hosted Apache Kafka and Schema Registry end-to-end

  • Operate Debezium change data capture pipelines and BigQuery sink loaders

  • Run Kubernetes workloads, including resource management and autoscaling

  • Automate access management and infrastructure as code via GitLab CI/CD

  • Own observability and infrastructure costs in Datadog

From the employer’s posting
You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end
You operate our Debezium-based change data capture pipelines
You run our workloads on Kubernetes, including Navarch
You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines
You own observability and infra costs - Datadog across Kafka and sink loaders

Benefits in the posting

Full benefits wording
  • Do you want to move to Germany? No problem – we offer you an attractive relocation package to give you a smooth start.
  • We are team players: From day one, you will connect not only with your team but also with others through our digital onboarding journey, the buddy program, and regular team and company events, all-hands meetings, powerful mornings, and much more!
  • Bewerben

From the employer’s posting.

About Kaufland e-commerce Services GmbH & Co. KG

We are the tech powerhouse behind Kaufland’s international online marketplaces and a company within the Schwarz Group.

In the employer’s words · Read in context

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,766 similar postings that came down. Coming down is not always a hire.

Kaufland e-commerce Services GmbH & Co. KG is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Azure
  • BigQuery
  • Datadog
  • dbt
  • GCP
  • Kafka
  • Kubernetes
  • Spark
  • Terraform
  • Airflow
  • Dagster
Where the posting names them
- You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders - You run our workloads on Kubernetes, including Navarch - our self-built workflow orchestrator executing ~7,500 SQL and Python tasks daily - owning resource management, autoscaling, and debugging - You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines, replacing manual tickets with code-driven policies
- You manage infrastructure and access as code across multiple environments (ideally Terraform and Ansible; Pulumi, Helm or serious configuration management also counts) following a strict least-privilege IAM approach across multiple environments, ideally with GCP experience or transferable AWS/Azure knowledge - You use production-grade Python and SQL as practical tools, applying a cost-conscious mindset to query performance, scanning volume, and data pruning - You thrive in a low-process, Kanban-driven environment where seniors self-organize, rotate weekly triage duties without micro-management, and prefer automating recurring requests over manually repeating them
- You demonstrate strong production experience with Kubernetes, master resource management and autoscaling, and possess sharp debugging reflexes for complex failure modes - You manage infrastructure and access as code across multiple environments (ideally Terraform and Ansible; Pulumi, Helm or serious configuration management also counts) following a strict least-privilege IAM approach across multiple environments, ideally with GCP experience or transferable AWS/Azure knowledge - You use production-grade Python and SQL as practical tools, applying a cost-conscious mindset to query performance, scanning volume, and data pruning
- You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end, managing ACLs, client quotas, certificates, upgrades, and disaster recovery - You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders - You run our workloads on Kubernetes, including Navarch - our self-built workflow orchestrator executing ~7,500 SQL and Python tasks daily - owning resource management, autoscaling, and debugging
- You carry your share of triage, one week in three - handling ingestion and access requests, schema alerts, and supporting analysts, while helping automate this layer via AI-assisted review - You act as a senior sparring partner alongside two senior data engineers (reporting to the Head of Data & Analytics) - driving design reviews and multi-quarter initiatives, with room to grow into BigQuery architecture over time: access frameworks, partitioning and slot strategy, the pipelines and models on top - Optional: You take part in our 24/7 on-call rotation
- You thrive in a low-process, Kanban-driven environment where seniors self-organize, rotate weekly triage duties without micro-management, and prefer automating recurring requests over manually repeating them - Optional: You bring skills or interest in object-oriented design, data modeling/dbt, BigQuery architecture, orchestration frameworks (Airflow, Dagster), stream processing (Beam, Flink, Spark), or internal automation (n8n, AI triage bots). - You are fluent in English (C1 level) and enjoy working in an international team environment
- You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines, replacing manual tickets with code-driven policies - You own observability and infra costs - Datadog across Kafka and sink loaders, Slack-native alerting, and maintaining an honest view of K8s, Kafka retention, and log volume expenses - You carry your share of triage, one week in three - handling ingestion and access requests, schema alerts, and supporting analysts, while helping automate this layer via AI-assisted review
Your tasks – this is what awaits you in detail - You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end, managing ACLs, client quotas, certificates, upgrades, and disaster recovery - You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders
- You have several years of experience operating production infrastructure you were personally responsible for, including on-call rotation. You have run systems that broke, can explain what went wrong and how you permanently fixed it, and can detail a specific trade-off you navigated backed by concrete numbers - You have deep hands-on expertise in Apache Kafka broker operations, including cluster sizing, partition rebalancing, replication, ISR behavior, and version upgrades - You have operated cross-system data replication in production - ideally Debezium on Kafka Connect, or database replication via binlog, GTID, WAL, or agent-based pipelines
- You have deep hands-on expertise in Apache Kafka broker operations, including cluster sizing, partition rebalancing, replication, ISR behavior, and version upgrades - You have operated cross-system data replication in production - ideally Debezium on Kafka Connect, or database replication via binlog, GTID, WAL, or agent-based pipelines - You demonstrate strong production experience with Kubernetes, master resource management and autoscaling, and possess sharp debugging reflexes for complex failure modes
- You have operated cross-system data replication in production - ideally Debezium on Kafka Connect, or database replication via binlog, GTID, WAL, or agent-based pipelines - You demonstrate strong production experience with Kubernetes, master resource management and autoscaling, and possess sharp debugging reflexes for complex failure modes - You manage infrastructure and access as code across multiple environments (ideally Terraform and Ansible; Pulumi, Helm or serious configuration management also counts) following a strict least-privilege IAM approach across multiple environments, ideally with GCP experience or transferable AWS/Azure knowledge

Your next step

Complete your application on real-digital.jobs.personio.com. The employer’s form will show what is required.

Applying through Personio

  • No account needed. The 20 MB limit covers all your files together, not each one.

Already applied? Track this application

Job description

View original posting ↗

Anstellungsdetails

Permanent Contract, Full- or Part-Time, Remote or Cologne / Düsseldorf / Darmstadt / Berlin

Info

Who we are

We are the tech powerhouse behind Kaufland’s international online marketplaces and a company within the Schwarz Group. Driven by a start-up mentality and working on an equal footing within flat hierarchies, we develop the best marketplace solutions for our customers, sellers and partners. #FromEuropeForEurope

Day by day, our Tech & Product Team of about 400 experts pursues the goal of creating the best possible customer shopping experience for our online marketplace. Through innovative technical developments, they not only create an outstanding shopping experience but also lay the foundation for an optimal selling experience for our sellers. Learn more about our division, areas, and cross-functional teams here!

Aufgaben

Your tasks – this is what awaits you in detail

  • You run and own our self-hosted Apache Kafka backbone and Schema Registry end-to-end, managing ACLs, client quotas, certificates, upgrades, and disaster recovery
  • You operate our Debezium-based change data capture pipelines, overseeing connectors, snapshots, offsets, replica lag, and BigQuery sink loaders 
  • You run our workloads on Kubernetes, including Navarch - our self-built workflow orchestrator executing ~7,500 SQL and Python tasks daily - owning resource management, autoscaling, and debugging
  • You automate and own access management and infrastructure as code across our self-hosted GitLab CI/CD pipelines, replacing manual tickets with code-driven policies
  • You own observability and infra costs - Datadog across Kafka and sink loaders, Slack-native alerting, and maintaining an honest view of K8s, Kafka retention, and log volume expenses
  • You carry your share of triage, one week in three - handling ingestion and access requests, schema alerts, and supporting analysts, while helping automate this layer via AI-assisted review
  • You act as a senior sparring partner alongside two senior data engineers (reporting to the Head of Data & Analytics) - driving design reviews and multi-quarter initiatives, with room to grow into BigQuery architecture over time: access frameworks, partitioning and slot strategy, the pipelines and models on top
  • Optional: You take part in our 24/7 on-call rotation

Profil

Your profile – this is what we expect from you

  • You have several years of experience operating production infrastructure you were personally responsible for, including on-call rotation. You have run systems that broke, can explain what went wrong and how you permanently fixed it, and can detail a specific trade-off you navigated backed by concrete numbers
  • You have deep hands-on expertise in Apache Kafka broker operations, including cluster sizing, partition rebalancing, replication, ISR behavior, and version upgrades
  • You have operated cross-system data replication in production - ideally Debezium on Kafka Connect, or database replication via binlog, GTID, WAL, or agent-based pipelines
  • You demonstrate strong production experience with Kubernetes, master resource management and autoscaling, and possess sharp debugging reflexes for complex failure modes
  • You manage infrastructure and access as code across multiple environments (ideally Terraform and Ansible; Pulumi, Helm or serious configuration management also counts) following a strict least-privilege IAM approach across multiple environments, ideally with GCP experience or transferable AWS/Azure knowledge
  • You use production-grade Python and SQL as practical tools, applying a cost-conscious mindset to query performance, scanning volume, and data pruning
  • You thrive in a low-process, Kanban-driven environment where seniors self-organize, rotate weekly triage duties without micro-management, and prefer automating recurring requests over manually repeating them
  • Optional: You bring skills or interest in object-oriented design, data modeling/dbt, BigQuery architecture, orchestration frameworks (Airflow, Dagster), stream processing (Beam, Flink, Spark), or internal automation (n8n, AI triage bots).
  • You are fluent in English (C1 level) and enjoy working in an international team environment

Benefits

What we offer

  • Create your own work-life balance: You have the flexibility to choose between working remotely (within Germany) or from one of our locations in Cologne, Darmstadt, Düsseldorf, or in Berlin!
  • Do you want to move to Germany? No problem – we offer you an attractive relocation package to give you a smooth start. 
  • Urban Sports Club and RSG Group Fitness Studios: Get top deals for fitness, swimming, yoga and more
  • Mental Well-Being: We support you on your well-being journey with special offerings such as Instahelp, the digital platform for online psychological counseling
  • Vacation & Sabbatical: Enjoy 30 days of vacation per year and the opportunity to take a sabbatical once you have been part of the team for a certain period!
  • Option for Pluxee restaurant vouchers: Buy Pluxee vouchers through us and benefit from tax-advantaged meal allowances!
  • ‘Deutschlandticket’: We subsidize your train season ticket for more mobility
  • Employee Discount: You will receive a monthly coupon for Kaufland.de
  • Free choice of hardware: Mac or Lenovo, it’s up to you
  • Boost your growth: Benefit from our online language learning programs, diverse in-house training, and our automated 360-degree feedback. We cover the costs for relevant conferences, training opportunities, and approved team workshops to strengthen personal interactions
  • This is who we are: Our dynamic culture combines flat hierarchies, a start-up mentality, an international team of over 65 nationalities, and the strength of the Schwarz Group to provide you an agile and secure working environment.
  • We are team players: From day one, you will connect not only with your team but also with others through our digital onboarding journey, the buddy program, and regular team and company events, all-hands meetings, powerful mornings, and much more!
Check out our Principles & our blog for even more insights into our company culture!

Bewerben

Diversity at Kaufland e-commerce

We welcome applications from everyone, regardless of skin colour, sexual orientation, gender identity, age, disability, ethnic origin, religion and ideology. We are signatories to the Charta der Vielfalt (German Diversity Charter) – because we know that extraordinary things can only be achieved with diversity. Read more here! When applying, you can optionally include your pronouns in your resume.

Why are you the perfect fit for this position?
Don't bother with cover letters - we're interested in facts and figures! Feel free to share your Github profile with us in your application.

As we have very international teams, we would highly appreciate it to receive your CV or profile link in English.

We are looking forward to your application!
Kaufland e-commerce Services GmbH & Co. KG
Postal address:
Habsburgerring 2
50674 Köln

Ansprechpartner

Your contact person: Jennifer Biehl

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Remote oder Köln / Darmstadt / Düsseldorf / Berlin

Anstellungsdetails Permanent Contract, Full- or Part-Time, Remote or Cologne / Düsseldorf / Darmstadt / Berlin Info
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.