Back to jobs

Senior Data Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Design, build and run the Databricks platform, including jobs, clusters and Unity Catalog

  • Build medallion pipelines on Delta Lake using PySpark and Spark SQL

  • Ingest data from platform databases, SaaS APIs and partner feeds, including backfills

  • Schedule, monitor and troubleshoot multi-stage Databricks workflows

  • Tune Delta tables, cluster sizing and job design for speed and cost

From the employer’s posting
Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog.
Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit.
Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data.
Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete.
Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control.

What you’ll bring

All qualifications

Core experience

  • Python and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL.
  • Experience building data products, or supporting ML/AI workloads with feature or evaluation datasets.
Qualification wording
Python and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL.
Experience building data products, or supporting ML/AI workloads with feature or evaluation datasets.

About RWS Group

You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads.

In the employer’s words · Read in context

Apply at RWS Group

Posting record

Report an error
Status in our records
Live
First seen by us
Nov 6, 202616 days ago
Recorded sightings
16
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 16

Similar jobs usually come down between day 6 and day 56.

At RWS Group, jobs usually come down by about day 27.

From 14,766 similar postings that came down, and 13 of RWS Group’s. Coming down is not always a hire.

RWS Group is hiring

38 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring is picking up
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • BigQuery
  • Databricks
  • Delta Lake
  • GCP
  • Google Cloud Storage
  • Spark
  • Terraform
  • PySpark
Where the posting names them
- Full pipeline ownership: Has owned data pipelines from ingestion to production support, including incremental loading, backfills and data quality checks. - Python and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL. - Cloud fundamentals: Experience running data workloads on AWS or GCP, such as object storage, IAM and networking basics.
Responsibilities - Own the Databricks lakehouse: Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog. - Build medallion pipelines: Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit.
- Own the Databricks lakehouse: Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog. - Build medallion pipelines: Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit. - Integrate source systems: Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data.
- Hands-on Databricks experience: Commercial experience building and running production pipelines on Databricks, including Delta Lake, Workflows/Jobs and Unity Catalog. This is the core of the role. - Spark expertise: Strong PySpark and Spark SQL, with a working understanding of how Spark executes jobs and how to tune them. - Lakehouse design: Experience designing medallion (bronze/silver/gold) architectures and dimensional models that analysts can use directly.
- Python and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL. - Cloud fundamentals: Experience running data workloads on AWS or GCP, such as object storage, IAM and networking basics. - Engineering practices: Git, code review, automated testing and CI/CD for data code.
- Delta Live Tables / Lakeflow declarative pipelines, Auto Loader or structured streaming. - Cross-cloud setups, for example Databricks on AWS reading from or publishing to GCP (BigQuery, GCS). - GitHub Actions for CI/CD.
Job Purpose As a Senior Data Engineer in TrainAI, you will own the data platform that tracks and powers our AI data services, built on Databricks. Our data comes from the TrainAI platform, partner systems and third-party services. We bring it together in a Databricks lakehouse and serve it to product, operations, finance and analytics teams. You’ll have end-to-end ownership of our Databricks pipelines, from raw ingestion through curated bronze, silver and gold layers to monitoring in production. You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads. You’ll work inside a product engineering team rather than a separate data function, so you’ll be close to the people who use your data.
As a Senior Data Engineer in TrainAI, you will own the data platform that tracks and powers our AI data services, built on Databricks. Our data comes from the TrainAI platform, partner systems and third-party services. We bring it together in a Databricks lakehouse and serve it to product, operations, finance and analytics teams. You’ll have end-to-end ownership of our Databricks pipelines, from raw ingestion through curated bronze, silver and gold layers to monitoring in production. You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads. You’ll work inside a product engineering team rather than a separate data function, so you’ll be close to the people who use your data. Job Overview
- Integrate source systems: Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data. - Orchestrate and monitor: Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete. - Optimise performance and cost: Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control.
- Govern and secure data: Manage access, lineage and data quality through Unity Catalog, and handle sensitive and personal data safely. - Engineer it like software: Treat pipelines as code, with Git, code review, automated tests, CI/CD and Databricks Asset Bundles. - Collaborate across teams: Work with engineers, analysts and business stakeholders to turn their questions into well-modelled, trustworthy datasets.
Requirements - Hands-on Databricks experience: Commercial experience building and running production pipelines on Databricks, including Delta Lake, Workflows/Jobs and Unity Catalog. This is the core of the role. - Spark expertise: Strong PySpark and Spark SQL, with a working understanding of how Spark executes jobs and how to tune them.
Nice to have - Databricks certification (Data Engineer Associate or Professional). - Databricks Asset Bundles, the Databricks Terraform provider, or other infrastructure-as-code for data platforms.
- Databricks certification (Data Engineer Associate or Professional). - Databricks Asset Bundles, the Databricks Terraform provider, or other infrastructure-as-code for data platforms. - Delta Live Tables / Lakeflow declarative pipelines, Auto Loader or structured streaming.
Why Is This Role Different? - You own the platform. You’ll be TrainAI’s dedicated data engineer, with real ownership of how our Databricks platform is designed and run, not just a ticket queue. - You’re part of the product team. You’ll sit with the engineers building the TrainAI platform, so you’ll see how your data is used and help shape what we build.
- Orchestrate and monitor: Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete. - Optimise performance and cost: Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control. - Govern and secure data: Manage access, lineage and data quality through Unity Catalog, and handle sensitive and personal data safely.
- Databricks Asset Bundles, the Databricks Terraform provider, or other infrastructure-as-code for data platforms. - Delta Live Tables / Lakeflow declarative pipelines, Auto Loader or structured streaming. - Cross-cloud setups, for example Databricks on AWS reading from or publishing to GCP (BigQuery, GCS).

Your next step

Complete your application on careers-rws.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Job description

View original posting ↗

Job Purpose

About RWS 

RWS is a global leader in content, translation, and intellectual property services. With more than 60 years of experience, RWS helps the world’s top brands grow by ensuring they are understood anywhere, in any language. The company combines proprietary technology with deep human expertise to deliver high-quality, compliant, and scalable solutions across industries such as life sciences, technology, finance, and legal. 

About TrainAI 

Training or fine-tuning artificial intelligence (AI) requires data. LOTS of data. However, not just any data will do – our clients need responsible AI data that’s targeted, accurate and reliable to ensure machine learning (ML) success. But preparing AI training data is a monumental task that can take up the vast majority of AI project time, leaving AI teams with precious little time to focus on developing, deploying and evaluating ML models. TrainAI by RWS helps our clients address this challenge head-on. 

With a seamless blend of technological understanding and human intelligence, TrainAI provides complete, end-to-end data collection and content generation, data annotation or labelling, human-in-the-loop data validation and generative AI data services for all types of AI, in any language, at any scale, based on the principles of responsible AI. Today, TrainAI supports four of the world’s top five technology companies, enhancing the performance of their generative AI by providing services such as prompt engineering, response refinement and red teaming with locale-specific domain experts across a broad range of topic areas and educational levels. 

Job Purpose 

As a Senior Data Engineer in TrainAI, you will own the data platform that tracks and powers our AI data services, built on Databricks. Our data comes from the TrainAI platform, partner systems and third-party services. We bring it together in a Databricks lakehouse and serve it to product, operations, finance and analytics teams. 

You’ll have end-to-end ownership of our Databricks pipelines, from raw ingestion through curated bronze, silver and gold layers to monitoring in production. You’ll also be the team’s Databricks expert, setting the standards for how we build, test and deploy data workloads. You’ll work inside a product engineering team rather than a separate data function, so you’ll be close to the people who use your data. 

Job Overview

Responsibilities 

  • Own the Databricks lakehouse: Design, build and run our Databricks platform end to end, including workspaces, clusters and SQL warehouses, jobs and Unity Catalog. 
  • Build medallion pipelines: Build reliable ingestion and transformation pipelines through bronze, silver and gold layers on Delta Lake, using PySpark, Spark SQL and Delta Live Tables / Lakeflow where they fit. 
  • Integrate source systems: Ingest data from our platform databases, SaaS APIs and partner feeds, including incremental loads, change data capture and backfills of historical data. 
  • Orchestrate and monitor: Schedule and monitor multi-stage workflows with Databricks Workflows/Jobs. Troubleshoot failures and keep data fresh and complete. 
  • Optimise performance and cost: Tune Delta tables (partitioning, Z-ordering / liquid clustering, file compaction), cluster sizing and job design to keep queries fast and spend under control. 
  • Govern and secure data: Manage access, lineage and data quality through Unity Catalog, and handle sensitive and personal data safely. 
  • Engineer it like software: Treat pipelines as code, with Git, code review, automated tests, CI/CD and Databricks Asset Bundles. 
  • Collaborate across teams: Work with engineers, analysts and business stakeholders to turn their questions into well-modelled, trustworthy datasets. 

Requirements 

  • Hands-on Databricks experience: Commercial experience building and running production pipelines on Databricks, including Delta Lake, Workflows/Jobs and Unity Catalog. This is the core of the role. 
  • Spark expertise: Strong PySpark and Spark SQL, with a working understanding of how Spark executes jobs and how to tune them. 
  • Lakehouse design: Experience designing medallion (bronze/silver/gold) architectures and dimensional models that analysts can use directly. 
  • Full pipeline ownership: Has owned data pipelines from ingestion to production support, including incremental loading, backfills and data quality checks. 
  • Python and SQL: Strong Python for pipelines, API integrations and tooling, and advanced SQL. 
  • Cloud fundamentals: Experience running data workloads on AWS or GCP, such as object storage, IAM and networking basics. 
  • Engineering practices: Git, code review, automated testing and CI/CD for data code. 

Nice to have 

  • Databricks certification (Data Engineer Associate or Professional). 
  • Databricks Asset Bundles, the Databricks Terraform provider, or other infrastructure-as-code for data platforms. 
  • Delta Live Tables / Lakeflow declarative pipelines, Auto Loader or structured streaming. 
  • Cross-cloud setups, for example Databricks on AWS reading from or publishing to GCP (BigQuery, GCS). 
  • GitHub Actions for CI/CD. 
  • Experience building data products, or supporting ML/AI workloads with feature or evaluation datasets. 

Why Is This Role Different? 

  • You own the platform. You’ll be TrainAI’s dedicated data engineer, with real ownership of how our Databricks platform is designed and run, not just a ticket queue. 
  • You’re part of the product team. You’ll sit with the engineers building the TrainAI platform, so you’ll see how your data is used and help shape what we build. 
  • Your work has an impact. TrainAI supports four of the world’s top five technology companies, and the data you build drives decisions across delivery, quality and finance.

Life at RWS

Life at RWS - If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood, then you’ll love life at RWS. 

 

Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career. 

 

In return, we expect all our people to live by the values that unite us: to partner, putting clients fist and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients.

 

RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics. 

RWS Values 

 

Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS.

 

Recruitment Agencies: RWS Holdings PLC does not accept agency resumes.  Please do not forward any unsolicited resumes to any RWS employees.  Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.#LI-MS1, #LI-Hybrid

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Dublin

Get the 3Ps right – Partner, Pioneer, Progress – and we´ll Deliver together as RWS. Recruitment Agencies: RWS Holdings PLC does not accept agency resumes. Please do not forward any unsolicited resumes to any RWS employees. Any unsolicited resume received will be treated as the property of RWS and Terms & Conditions associated with the use of such resume will be considered null and void.#LI-MS1, #LI-Hybrid
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.