Pay
In line with similar jobs
$165K–$215K against $127K–$190K, the middle half of what similar US postings state.
From 2,239 postings in the last year. Stated ranges, not salaries paid.
Movable Ink - US
Open 3 months, first seen by us 94 days agoEnjoys working in a fast-paced, goal-driven environment The base pay range for this position is $165K - $215K USD/year, which can include additional bonus depending on the position ultimately offered, in addition to a full range of medical, financial, and/or other benefits. The base pay offered may vary depending on job-related knowledge, skills, and experience. Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.Read the full posting
Build and maintain production data pipelines for AI-driven personalization
Own and scale Spark batch pipelines, including cluster tuning on GCP Dataproc
Build and maintain the ML Data Lake for quality, access and efficient storage
Support data needs of ML engineers and scientists for training and evaluation
Find and fix performance bottlenecks and scaling limits in pipelines
Build, maintain, and optimize production data pipelines that power AI-driven personalization at scale
Own and scale Spark-based batch pipelines, including cluster configuration, tuning, and performance optimization across GCP Dataproc
Build and maintain our ML Data Lake, ensuring data quality, accessibility, and efficient storage
Support the data needs of ML Engineers and Scientists for model development, training, and evaluation
Identify and resolve performance bottlenecks and scaling limitations in data pipelines and infrastructure
5+ years of data engineering experience
Deep expertise with Apache Spark, including the PySpark DataFrame API and experience solving challenging scaling problems
Experience with large-scale data processing, cluster configuration, optimization, and tuning (we use GCP Dataproc)
Experience with data storage formats (we use Parquet, Delta Lake)
Experience with event streaming data (we use Kafka)
Experience with cloud computing platforms (we use Google Cloud Platform)
Open 3 monthsWe first saw this posting 94 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
In line with similar jobs
$165K–$215K against $127K–$190K, the middle half of what similar US postings state.
From 2,239 postings in the last year. Stated ranges, not salaries paid.
Day 94
Up longer than most. Similar jobs usually come down between day 6 and day 55.
From 13,324 similar postings that came down. Coming down is not always a hire.
9 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- Experience with large-scale data processing, cluster configuration, optimization, and tuning (we use GCP Dataproc) - Strong software development skills in Python (unit testing, git, code review, CI/CD) - Experience with data storage formats (we use Parquet, Delta Lake)
- Strong software development skills in Python (unit testing, git, code review, CI/CD) - Experience with data storage formats (we use Parquet, Delta Lake) - Experience with event streaming data (we use Kafka)
- Experience with advanced query optimization - Familiar with Software Development Lifecycle practices, such as continuous integration/continuous delivery and automated deployment (we use Docker, Kubernetes, and GitHub Actions) - Ability to collaborate with technical partners - you'll be working closely with ML engineers, scientists, and other teams to determine requirements and make design decisions
- Experience with event streaming data (we use Kafka) - Experience with cloud computing platforms (we use Google Cloud Platform) - Experience with advanced query optimization
- Experience with data storage formats (we use Parquet, Delta Lake) - Experience with event streaming data (we use Kafka) - Experience with cloud computing platforms (we use Google Cloud Platform)
Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most innovative brands rely on Movable Ink to maximize revenue, simplify workflow and boost marketing agility. Headquartered in New York City with close to 600 employees, Movable Ink serves its global client base with operations throughout North America, Central America, Europe, Australia, and Japan. The AI Systems team owns the core recommendations engine and ML platform that powers billions of AI-driven marketing decisions daily across some of the world's largest consumer brands. As a Senior Data Engineer, you will own the Spark-based data pipelines and data infrastructure at the heart of this system - building, scaling, and optimizing the data layer that feeds our production ML models. You will work alongside ML engineers and scientists in a collaborative environment, contributing data pipelines and products to power our core recommender systems and our DaVinci Personalization product. This is an opportunity to work end-to-end on large-scale data systems that touch millions of customers, on a team working at the intersection of data engineering and machine learning. This role will be reporting to the Director of Engineering (AI/ML).
- Build, maintain, and optimize production data pipelines that power AI-driven personalization at scale across content selection, send-time optimization, subject line personalization, and frequency capping - Own and scale Spark-based batch pipelines, including cluster configuration, tuning, and performance optimization across GCP Dataproc - Build and maintain our ML Data Lake, ensuring data quality, accessibility, and efficient storage
- 5+ years of data engineering experience - Deep expertise with Apache Spark, including the PySpark DataFrame API and experience solving challenging scaling problems - Experience with large-scale data processing, cluster configuration, optimization, and tuning (we use GCP Dataproc)
Complete your application on movableink.com. The employer’s form will show what is required.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
The AI Systems team owns the core recommendations engine and ML platform that powers billions of AI-driven marketing decisions daily across some of the world's largest consumer brands. As a Senior Data Engineer, you will own the Spark-based data pipelines and data infrastructure at the heart of this system - building, scaling, and optimizing the data layer that feeds our production ML models. You will work alongside ML engineers and scientists in a collaborative environment, contributing data pipelines and products to power our core recommender systems and our DaVinci Personalization product. This is an opportunity to work end-to-end on large-scale data systems that touch millions of customers, on a team working at the intersection of data engineering and machine learning.
This role will be reporting to the Director of Engineering (AI/ML).
Responsibilities:
Qualifications:
The base pay range for this position is $165K - $215K USD/year, which can include additional bonus depending on the position ultimately offered, in addition to a full range of medical, financial, and/or other benefits. The base pay offered may vary depending on job-related knowledge, skills, and experience.
Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.
We welcome and employ people regardless of race, color, gender identity or expression, religion, genetic information, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, ethnicity, family or marital status, physical and mental ability, political affiliation, disability, Veteran status, or other protected characteristics. We are proud to be an equal opportunity employer.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Enjoys working in a fast-paced, goal-driven environment The base pay range for this position is $165K - $215K USD/year, which can include additional bonus depending on the position ultimately offered, in addition to a full range of medical, financial, and/or other benefits. The base pay offered may vary depending on job-related knowledge, skills, and experience. Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger.
Movable Ink - US
Working pattern and location restrictions need checking in the full posting.
Studies have shown that women, communities of color, and historically underrepresented people are less likely to apply to jobs unless they meet every single qualification. We are committed to building a diverse and inclusive culture where all Inkers can thrive. If you’re excited about the role but don’t meet all of the abovementioned qualifications, we encourage you to apply. Our differences bring a breadth of knowledge and perspectives that makes us collectively stronger. We welcome and employ people regardless of race, color, gender identity or expression, religion, genetic information, parental or pregnancy status, national origin, sexual orientation, age, citizenship, marital status, ethnicity, family or marital status, physical and mental ability, political affiliation, disability, Veteran status, or other protected characteristics. We are proud to be an equal opportunity employer.