Data Engineer Data Pipelines and ETL

Storytelling is, and will always be, the heart of what we do at Skydance.
Our vision is to build a thriving entertainment ecosystem where stories and worlds are imagined, brought to life and experienced. We create for every age and audience, anchored by the strength of our content and experiences and the depth of our connection with fans. We are creator-first, audience-focused, tech-forward, globally scaled.

 

Here, you’ll work with talented teams that move fast, think boldly and collaborate with purpose to deliver results. We aim high, champion the best ideas and win together, earning the trust of our employees, creators, partners and audiences every day.

 

If you’re energized by the opportunity to help build the next-generation global media and entertainment company powered by creativity and technology, we’d be thrilled to welcome you aboard. LET’S GO!

 

 

Data Engineer – Data Pipeline & ETL

 

46034

 

Overview and Responsibilities

 

Job Summary

 

The Data Engineering team is hiring a Data Engineer – Data Pipeline & ETL. You will help build and maintain scalable data platforms and ETL/ELT pipelines in a fast-moving environment. In this role, you will build and support batch and real-time data systems powering analytics, ML, and AI applications. You will also grow your expertise in modern data architecture and cloud-native best practices.

Key Responsibilities

 

Build and Maintain Scalable Data Pipelines

Design, develop, and maintain scalable batch and streaming data pipelines for large-scale structured and unstructured datasets.

Build robust ETL/ELT frameworks supporting analytics, BI, experimentation, and machine learning use cases.

Optimize pipelines for performance, reliability, scalability, and cost efficiency.

Implement advanced ingestion patterns including CDC, incremental loads, and event-driven processing.

Data Modeling & Data Warehouse Architecture

Design scalable, dimensional, and hybrid data models optimized for analytics and ML use cases.

Develop reusable transformation layers (semantic layers) that serve BI, ML, and AI applications.

Write optimized, production-grade SQL for large-scale analytics workloads.

Contribute to query optimization, indexing, partitioning, and performance tuning across distributed systems and cloud warehouses.

Modern Data Pipeline Development

Build and maintain modular data components following established framework patterns.

Contribute to architectural decisions across streaming systems, data lakes, and warehouses.

Data Quality, Governance & Observability

Implement automated data validation, anomaly detection, and monitoring frameworks.

Establish data lineage and metadata standards to support reproducibility in ML workflows.

Enforce governance, privacy, and security best practices, particularly for sensitive AI datasets.

Ensure responsible AI data usage and compliance standards.

 

Required Technical Skills

 

Advanced Data Pipeline & ETL/ELT Expertise

2–4+ years of experience building and scaling ETL/ELT pipelines in production environments.

Experience with workflow orchestration tools such as Airflow, Composer, or similar platforms.

Strong understanding of distributed data processing concepts.

SQL & Data Modeling for Analytics & ML

Expert-level SQL skills for large-scale transformation and analytics.

Experience designing scalable warehouse schemas and ML-ready data layers.

Strong experience optimizing complex queries across multi-terabyte datasets.

Programming & ML Data Integration

Proficiency in Python (or similar language) for data processing and ML pipeline integration.

Experience with distributed processing frameworks such as Spark.

Familiarity integrating data pipelines with ML platforms such as Vertex AI (preferred), Databricks ML, or equivalent.

Streaming & Event-Driven Systems

Experience building real-time data pipelines using Kafka, Pub/Sub, or similar technologies.

Understanding of feature streaming, low-latency data processing, and event-driven architectures.

Ability to architect and build real-time dashboards using Superset.

Cloud & Modern AI Data Platforms

Experience designing cloud-native data architectures (GCP preferred).

Experience with Lakehouse architectures and cloud data warehouses.

Familiarity with vector databases, embeddings pipelines, and AI-serving infrastructure is a plus.

 

Basic Qualifications

 

Bachelor's or Master's degree in Computer Science, Engineering, or related field (or equivalent experience).

2–4+ years of experience in data engineering, data pipeline development, or related fields.

Strong foundation in modern data engineering principles, distributed systems design, and cloud-native architectures.

Demonstrated ability to design and operate large-scale production data systems.

Proven track record of technical leadership and cross-functional collaboration.

Strong problem-solving skills and ability to thrive in complex, fast-paced environments.

Detail-oriented and committed to engineering excellence and continuous improvement.

Understanding of feature streaming, low-latency data processing, and event-driven architectures. Work closely with the streaming team and architect/build Realtime dashboards using Superset. Cloud & Modern AI Data Platforms.

Experience designing cloud-native data architectures (GCP preferred) Experience with Lakehouse architectures and cloud data warehouses. Knowledge with vector databases, embeddings pipelines, and AI-serving infrastructure is a plus.

#LI-RJ1

 

 

 

 

Paramount Streaming, a division within Paramount Global, is the home to the company's direct-to-consumer services spanning free and paid in the form of Pluto TV and Paramount+. Pluto TV is the global leader in free ad-supported TV, delivering more than 1,400 global channels and an extensive library of streaming content, including live and original channels. Paramount+, digital subscription video-on-demand and live streaming service, combines live sports, breaking news, and A Mountain of Entertainment™. Paramount+ features an expansive library of original series, hit shows and popular movies across every genre from world-renowned brands and production studios, including SHOWTIME®.

 

 

ADDITIONAL INFORMATION

 

Hiring Salary Range: $98,400.00 - 147,600.00. 

 

The hiring salary range for this position applies to New York, California, Colorado, Washington state, and most other geographies. Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to geographic location, market demands, experience, training, and education.  The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage, disability benefits, tuition assistance program and PTO or, if applicable,  as otherwise dictated by the appropriate Collective Bargaining Agreement. This position is bonus eligible.  

 

 

Skydance is an equal opportunity employer (EOE)

 

We embrace the opportunity to build a workforce that reflects a wide array of perspectives, backgrounds and experiences. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit. In line with the laws of the country or region in which the role is based, this includes consideration without regard to race, color, ethnicity, national origin, citizenship status, religion or belief, sex, gender, gender identity or expression, sexual orientation, age, marital status, pregnancy, parenthood, physical or mental disability, genetic information, military or protected veteran status, union status or any other category protected by applicable law.

 

If you are a qualified individual with a disability, you may request a reasonable accommodation during the job application and/or recruitment process. You can request reasonable accommodations by calling 212.846.5500 or by sending an email to paramountaccommodations@paramount.com. Only messages left for this purpose will be returned.