Senior Data Engineer
New York, NEW YORK, United States
- Pay
$140,000–160,000/yearAnnual period assumed — pay source
Hybrid: This position has been designated as hybrid, generally contributing from the office a minimum of three days per week from our NYC office. Salary: $140,000 - $160,000. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks. As part of our selection process, candidates may be required to attend an in-person interview with a VERSANT employee in New York. VERSANT's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
Read the full posting- Work setup
- Unconfirmed
- Employment
- Unconfirmed
What you’ll work on
Full postingDesign and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel
Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration
Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
From the employer’s posting
Key Responsibilities Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
compliance-driven practices for sensitive environments Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow
Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns Implement data governance and security using Unity Catalog, RBAC, and
What you’ll bring
All qualificationsCore experience
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark)
- Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
- Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
- Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
- Experience working with modern data architectures, including event-driven and distributed systems
Preferred experience
- Experience building Lakehouse platforms and medallion pipelines in Databricks
- Strong communication and collaboration skills
- Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
- Ability to balance near-term delivery with thoughtful technical design
Qualification wording
Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark)
Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
Experience working with modern data architectures, including event-driven and distributed systems
Experience building Lakehouse platforms and medallion pipelines in Databricks
Strong communication and collaboration skills
Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
Ability to balance near-term delivery with thoughtful technical design
Tools in this posting
- SQL
- Databricks
- Delta
- MLflow
- Spark
- Airflow
- Dagster
- PySpark
Source — Tool mentions in context
- 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark) - Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production - Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
- Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel - Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns - Implement data governance and security using Unity Catalog, RBAC, and
- Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration - Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow - Collaborate with Data Science teams on ML workflows, including MLflow,
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience - 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark) - Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
- Proficiency with Git and collaborative development workflows - Build and operate batch and real-time ingestion pipelines using Spark based batch and streaming patterns (e.g., Structured Streaming, CDC), with experience on Databricks or comparable platforms - Solid understanding of infrastructure, networking, and data security fundamentals
Preferred Qualifications - Experience building Lakehouse platforms and medallion pipelines in Databricks - Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
- Comfortable using AI-assisted development tools (e.g., ChatGPT) - Databricks or cloud certifications (e.g., Databricks Certified Data Engineer) What Sets You Apart
Key Responsibilities - Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel - Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
- Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow - Collaborate with Data Science teams on ML workflows, including MLflow, feature store integration, and model lifecycle management
- Hands-on experience with CI/CD pipelines, orchestration tools, and infrastructure-as-code - Experience with Lakeflow Spark Declarative Pipelines (SDP), MLflow, feature stores, and MLOps practices - Background in media and entertainment data (e.g., video metadata, ad tech, audience analytics)
- Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production - Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto - Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
- Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto - Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems - Experience working with modern data architectures, including event-driven and distributed systems
Job description
Job Description
The Data Engineering team is seeking a Senior Data Engineer to help design, build, and scale the modern data platform that powers analytics, data science, and data products across Versant brands. In this role, you’ll collaborate closely with Data Product, Data Science, Analytics, and Engineering teams to deliver reliable, high-impact data solutions used by hundreds of internal users. We're looking for engineers who enjoy hands-on development, take ownership of production systems, and influence implementation through collaboration and technical expertise.
Key Responsibilities
- Design and implement lakehouse architecture using Delta Lake, including medallion pipeline patterns (Bronze/Silver/Gold), schema enforcement, and time travel
- Build and operate batch and real-time ingestion pipelines leveraging Databricks Auto Loader, Structured Streaming, and Change Data Capture patterns
- Implement data governance and security using Unity Catalog, RBAC, and
compliance-driven practices for sensitive environments - Optimize performance and manage costs through FinOps strategies, including cluster sizing, workload tagging, Spark tuning, and Photon acceleration
- Design, implement, and maintain CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, and tools such as Airflow
- Collaborate with Data Science teams on ML workflows, including MLflow,
feature store integration, and model lifecycle management - Ensure data quality, observability, and lineage across media-specific datasets
such as streaming logs, ad impressions, and audience metrics - Provide technical mentorship through code reviews, pairing and knowledge sharing
Qualifications
- Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience
- 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark)
- Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
- Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
- Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
- Experience working with modern data architectures, including event-driven and distributed systems
- Proficiency with Git and collaborative development workflows
- Build and operate batch and real-time ingestion pipelines using Spark based batch and streaming patterns (e.g., Structured Streaming, CDC), with experience on Databricks or comparable platforms
- Solid understanding of infrastructure, networking, and data security fundamentals
Preferred Qualifications
- Experience building Lakehouse platforms and medallion pipelines in Databricks
- Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
- Hands-on experience with CI/CD pipelines, orchestration tools, and infrastructure-as-code
- Experience with Lakeflow Spark Declarative Pipelines (SDP), MLflow, feature stores, and MLOps practices
- Background in media and entertainment data (e.g., video metadata, ad tech, audience analytics)
- Experience building data platforms within the media industry, with a strong
understanding of audience analytics - Experience working with large-scale analytical datasets (e.g., event logs, clickstream data, audience metrics)
- Comfortable using AI-assisted development tools (e.g., ChatGPT)
- Databricks or cloud certifications (e.g., Databricks Certified Data Engineer)
What Sets You Apart
- Passion for clean, reliable, and scalable data systems
- Strong communication and collaboration skills
- Ability to balance near-term delivery with thoughtful technical design
- Curiosity and a growth mindset
- A team-first attitude who supports and uplifts others
Additional Information
- Hybrid: This position has been designated as hybrid, generally contributing from the office a minimum of three days per week from our NYC office.
- Salary: $140,000 - $160,000. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks.
- As part of our selection process, candidates may be required to attend an in-person interview with a VERSANT employee in New York. VERSANT's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
- If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to candidateaccessibility@versantmedia.com.
- VERSANT is committed to fair and equitable compensation practices. We include a good faith pay range for each position to comply with applicable state and local pay transparency laws and to promote equity across our organization. Actual compensation will be based on factors such as the candidate's skills, qualifications, experience, and location and may include additional forms of compensation and benefits such as health insurance, retirement plans, paid time off, etc.
Additional Information
As part of our selection process, external candidates may be required to attend an in-person interview with a VERSANT Media employee at one of our locations prior to a hiring decision. VERSANT Media's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to candidateaccessibility@versantmedia.com.
VERSANT Media is committed to fair and equitable compensation practices. We include a good faith pay range for each position to comply with applicable state and local pay transparency laws and to promote equity across our organization. Actual compensation will be based on factors such as the candidate's skills, qualifications, experience, and location and may include additional forms of compensation and benefits such as health insurance, retirement plans, paid time off, etc.
VERSANT Media is not accepting unsolicited assistance from search firms for this employment opportunity. All resumes submitted by search firms to any employee at VERSANT via-email, the Internet, or in any form and/or method without a valid written Statement of Work in place for this position from VERSANT's Talent Acquisition team will be deemed the sole property of VERSANT. No fee will be paid in the event the candidate is hired by VERSANT as a result of the referral or through other means.
Company Description
VERSANT (Nasdaq: VSNT) is an industry-changing media and entertainment business and home to trusted brands that shape culture, inform audiences, and build lasting connections. It operates across four core markets: political news and opinion, business news and personal finance, golf, and sports and genre entertainment. These markets are served through a powerful portfolio of iconic and innovative brands, including CNBC, MS NOW, USA Network, Golf Channel, Oxygen, E!, SYFY, and Versant's sports division USA Sports, along with complementary digital assets including Fandango, Rotten Tomatoes, GolfNow and GolfPass.
Your next step
- Have your CV and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
Complete your application on jobs.smartrecruiters.com. The employer’s form will show what is required.
Already applied? Track this application
Source & posting history
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
Hybrid: This position has been designated as hybrid, generally contributing from the office a minimum of three days per week from our NYC office. Salary: $140,000 - $160,000. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks. As part of our selection process, candidates may be required to attend an in-person interview with a VERSANT employee in New York. VERSANT's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
- Location & working pattern
New York, NEW YORK, United States
Additional Information - Hybrid: This position has been designated as hybrid, generally contributing from the office a minimum of three days per week from our NYC office. - Salary: $140,000 - $160,000. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks.
- Work authorization
- Salary: $140,000 - $160,000. This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other benefits and perks. - As part of our selection process, candidates may be required to attend an in-person interview with a VERSANT employee in New York. VERSANT's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. - If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to candidateaccessibility@versantmedia.com.
More source context
Additional Information As part of our selection process, external candidates may be required to attend an in-person interview with a VERSANT Media employee at one of our locations prior to a hiring decision. VERSANT Media's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law. If you are a qualified individual with a disability or a disabled veteran and require support throughout the application and/or recruitment process as a result of your disability, you have the right to request a reasonable accommodation. You can submit your request to candidateaccessibility@versantmedia.com.
- Status in our records
- Active
- First seen by us
- Jul 2, 2026
- Recorded sightings
- 520
- Last seen by us
- Oct 1, 2026
These dates show when we found the listing. Check the employer’s website to confirm it is still accepting applications.
Report an errorSee how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.