Time since we first saw it
Day 46
Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
Cape Town
Live, first seen by us 46 days agoDesign and build batch and streaming ETL/ELT pipelines on Spark/Dataproc, Kafka and Pub/Sub
Own SLOs for freshness, success and latency, with monitoring and alerting
Participate in on-call as a Tier 2 responder, resolving incidents independently
Configure infrastructure as code for Dataproc, Kafka, Airflow, BigQuery and Cloud Storage
Tune query, partitioning and resource settings for performance and cost
Design and build scalable ETL/ELT and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub
Own and track SLOs for freshness, success, and latency. Implement monitoring, alerting, and data quality checks.
Participate in on-call as a Tier 2 responder, troubleshooting and resolving incidents independently
Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage
Tune performance and cost through query optimisation, partitioning, and resource configuration
3 to 5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale, or systems carrying stringent SLAs, multiple downstream consumers, or compliance requirements
Strong Python, plus production experience in a JVM language, with the ability to write production-quality code with proper error handling, logging, and testing. Scala is our primary pipeline language: if you don't have it yet, you'll need a real appetite to become strong in it
Experience with workflow orchestration such as Airflow: scheduling, dependencies, retry logic, and workflow coordination
Experience migrating legacy big-data platforms onto cloud-native alternatives
- Experience with Dataflow (Apache Beam), SingleStore, or BigTable - Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field is a plus - Experience in the digital marketing technology industry is a plus
From the employer’s posting.
impact.com is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer journey.
In the employer’s words · Read in context
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 46
Similar jobs usually come down between day 6 and day 56.
From 14,771 similar postings that came down. Coming down is not always a hire.
17 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- 3 to 5 years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at TB-scale, or systems carrying stringent SLAs, multiple downstream consumers, or compliance requirements - Strong Python, plus production experience in a JVM language, with the ability to write production-quality code with proper error handling, logging, and testing. Scala is our primary pipeline language: if you don't have it yet, you'll need a real appetite to become strong in it - Hands-on depth in either distributed batch processing (Spark: DataFrames, Spark SQL, partitioning, shuffles, fault tolerance) or streaming (Kafka or Pub/Sub: producers, consumers, topics, partitions, stream processing patterns), with working familiarity of the other
The platform: The platform has strong foundations: Scala and Spark pipelines processing TB-scale data, dozens of managed data connectors, Airflow on Astronomer for orchestration, a mature dbt transformation layer, and BigQuery as the core analytical warehouse. You'll also have room to shape the platform's next chapter: modernising parts of the compute stack, and building out governance frameworks, data contracts, SLOs, observability, cost management, and data quality monitoring within your domain. What You'll Do:
- Familiarity with dbt, Looker, or semantic layer concepts, and with dbt orchestration through Astronomer Cosmos - Functional Scala patterns (cats-effect and the Typelevel ecosystem), or JVM tuning exposure such as garbage collection, memory management, and thread pools - Observability tooling such as Grafana, Datadog, or Cloud Monitoring
- Strong Python, plus production experience in a JVM language, with the ability to write production-quality code with proper error handling, logging, and testing. Scala is our primary pipeline language: if you don't have it yet, you'll need a real appetite to become strong in it - Hands-on depth in either distributed batch processing (Spark: DataFrames, Spark SQL, partitioning, shuffles, fault tolerance) or streaming (Kafka or Pub/Sub: producers, consumers, topics, partitions, stream processing patterns), with working familiarity of the other - Advanced SQL, including complex queries, window functions, CTEs, and query optimisation
- Hands-on depth in either distributed batch processing (Spark: DataFrames, Spark SQL, partitioning, shuffles, fault tolerance) or streaming (Kafka or Pub/Sub: producers, consumers, topics, partitions, stream processing patterns), with working familiarity of the other - Advanced SQL, including complex queries, window functions, CTEs, and query optimisation - Experience with workflow orchestration such as Airflow: scheduling, dependencies, retry logic, and workflow coordination
What You'll Do: - End-to-end domain ownership: Own platform components and a pipeline domain end-to-end, including design, implementation, reliability, performance, and cost. Design and build scalable ETL/ELT and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub. Integrate diverse sources into BigQuery and other stores. Build modular, fault-tolerant components with graceful schema evolution. - Infrastructure & performance tuning: Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage. Tune performance and cost through query optimisation, partitioning, and resource configuration. Tune streaming configurations for throughput and reliability.
- End-to-end domain ownership: Own platform components and a pipeline domain end-to-end, including design, implementation, reliability, performance, and cost. Design and build scalable ETL/ELT and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub. Integrate diverse sources into BigQuery and other stores. Build modular, fault-tolerant components with graceful schema evolution. - Infrastructure & performance tuning: Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage. Tune performance and cost through query optimisation, partitioning, and resource configuration. Tune streaming configurations for throughput and reliability. - Reliability & incident response: Own and track SLOs for freshness, success, and latency. Implement monitoring, alerting, and data quality checks. Participate in on-call as a Tier 2 responder, troubleshooting and resolving incidents independently.
- Experience with workflow orchestration such as Airflow: scheduling, dependencies, retry logic, and workflow coordination - Working fluency with a major cloud platform, ideally GCP (BigQuery, Dataproc, Cloud Storage, Pub/Sub) - Solid engineering and operational practice: Git, CI/CD, automated testing, code review, monitoring, alerting, and incident response including on-call
- Functional Scala patterns (cats-effect and the Typelevel ecosystem), or JVM tuning exposure such as garbage collection, memory management, and thread pools - Observability tooling such as Grafana, Datadog, or Cloud Monitoring - Experience with Dataflow (Apache Beam), SingleStore, or BigTable
Impact's Data Platform Engineering team is looking for a Data Platform Engineer ready to independently own production pipelines and platform components at TB-scale, delivering data reliably, securely, and cost-effectively as the business grows. You'll design and build scalable batch and streaming pipelines, own the reliability, performance, and SLOs of your domain, and participate fully in on-call as a Tier 2 responder. You'll work within the Data Analytics Group (DAG), partnering closely with Analytics Engineers, Data Analysts, Data Scientists, and Data Product Managers, though you won't own dbt models, metric definitions, or reporting. We operate with a platform-as-a-product mindset: the platform is an internal product with clear interfaces, paved roads, and strong developer experience, and success is measured by the productivity of the teams who depend on it. Our ideal candidate combines solid distributed systems engineering with operational maturity, clear communication, and a habit of mentoring those earlier in their careers. The role reports to the Team Lead, Data Platform Engineering, and is based in Cape Town, hybrid, with two days per week in office. The platform:
- Experience migrating legacy big-data platforms onto cloud-native alternatives - Familiarity with dbt, Looker, or semantic layer concepts, and with dbt orchestration through Astronomer Cosmos - Functional Scala patterns (cats-effect and the Typelevel ecosystem), or JVM tuning exposure such as garbage collection, memory management, and thread pools
Nice to Have (Advantageous) Requirements: - Infrastructure as code (Terraform or equivalent) and automated deployment - Experience migrating legacy big-data platforms onto cloud-native alternatives
- Advanced SQL, including complex queries, window functions, CTEs, and query optimisation - Experience with workflow orchestration such as Airflow: scheduling, dependencies, retry logic, and workflow coordination - Working fluency with a major cloud platform, ideally GCP (BigQuery, Dataproc, Cloud Storage, Pub/Sub)
Complete your application on job-boards.greenhouse.io. The employer’s form will show what is required.
Already applied? Track this application
impact.com is the world’s leading commerce partnership marketing platform, transforming the way businesses grow by enabling them to discover, manage, and scale partnerships across the entire customer journey. From affiliates and influencers to content publishers, brand ambassadors, and customer advocates, impact.com empowers brands to drive trusted, performance-based growth through authentic relationships. Its award-winning products—Performance (affiliate), Creator (influencer), and Advocate (customer referral)—unify every type of partner into one integrated platform. As consumers increasingly rely on recommendations from people and communities they trust, impact.com helps brands show up where it matters most. Today, over 5,000 global brands, including Walmart, Uber, Shopify, Lenovo, L’Oréal, and Fanatics, rely on impact.com to power more than 225,000 partnerships that deliver measurable business results.
Impact's Data Platform Engineering team is looking for a Data Platform Engineer ready to independently own production pipelines and platform components at TB-scale, delivering data reliably, securely, and cost-effectively as the business grows.
You'll design and build scalable batch and streaming pipelines, own the reliability, performance, and SLOs of your domain, and participate fully in on-call as a Tier 2 responder. You'll work within the Data Analytics Group (DAG), partnering closely with Analytics Engineers, Data Analysts, Data Scientists, and Data Product Managers, though you won't own dbt models, metric definitions, or reporting. We operate with a platform-as-a-product mindset: the platform is an internal product with clear interfaces, paved roads, and strong developer experience, and success is measured by the productivity of the teams who depend on it. Our ideal candidate combines solid distributed systems engineering with operational maturity, clear communication, and a habit of mentoring those earlier in their careers. The role reports to the Team Lead, Data Platform Engineering, and is based in Cape Town, hybrid, with two days per week in office.
The platform has strong foundations: Scala and Spark pipelines processing TB-scale data, dozens of managed data connectors, Airflow on Astronomer for orchestration, a mature dbt transformation layer, and BigQuery as the core analytical warehouse. You'll also have room to shape the platform's next chapter: modernising parts of the compute stack, and building out governance frameworks, data contracts, SLOs, observability, cost management, and data quality monitoring within your domain.
Preferred Requirements:
At impact.com, we believe that when you’re happy and fulfilled, you do your best work. That’s why we’ve built a benefits package that supports your well-being, growth, and work-life balance.
impact.com is proud to be an equal opportunity workplace. All employees and applicants for employment shall be given fair treatment and equal employment opportunity regardless of their race, ethnicity or ancestry, color or caste, religion or belief, age, sex (including gender identity, gender reassignment, sexual orientation, pregnancy/maternity), national origin, weight, neurodivergence, disability, marital and civil partnership status, caregiving status, veteran status, genetic information, political affiliation, or other prohibited non-merit factors.
#LI-CT1
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Cape Town
Impact's Data Platform Engineering team is looking for a Data Platform Engineer ready to independently own production pipelines and platform components at TB-scale, delivering data reliably, securely, and cost-effectively as the business grows. You'll design and build scalable batch and streaming pipelines, own the reliability, performance, and SLOs of your domain, and participate fully in on-call as a Tier 2 responder. You'll work within the Data Analytics Group (DAG), partnering closely with Analytics Engineers, Data Analysts, Data Scientists, and Data Product Managers, though you won't own dbt models, metric definitions, or reporting. We operate with a platform-as-a-product mindset: the platform is an internal product with clear interfaces, paved roads, and strong developer experience, and success is measured by the productivity of the teams who depend on it. Our ideal candidate combines solid distributed systems engineering with operational maturity, clear communication, and a habit of mentoring those earlier in their careers. The role reports to the Team Lead, Data Platform Engineering, and is based in Cape Town, hybrid, with two days per week in office. The platform:
No clear work-authorization passage found. Eligibility is unconfirmed.