Back to jobs

Data Platform Manager- Hybrid

Pay
Pay not listedSimilar roles state $155K–$227K
Work setting
HybridLocation limits apply — work setting source
Overview Location: Hybrid, Pittsburgh, PAJob Type: Full Time / PermanentWork Authorization: No C2C or Sponsorship The A.C.Coy company has an immediate opening for a Data Platform Manager. This role will be responsible for designing, building, and optimizing enterprise wide data platforms within the Data Warehouse.
Read the full posting
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Lead and mentor a team of data engineers, including code reviews

  • Build and deploy scalable data pipelines on Azure Databricks

  • Define the Lakehouse architecture using Delta Lake medallion layers

  • Support troubleshooting and incident management for production data issues

  • Tune Spark jobs and Databricks clusters for throughput and cost

From the employer’s posting
Lead and mentor a team of data engineers, conducting code reviews and ensuring development standards
Lead the design, development and deployment of scalable and high-performance data pipelines using Azure Databricks
Define the end-to-end Lakehouse architecture using Delta Lake, implementing medallion architecture (Bronze, Silver, Gold layers)
Support troubleshooting and incident management for data-related issues in production
Tune Spark jobs and Databricks clusters to maximize throughput while maintaining cost efficiency

Before you apply

Work authorization
No visa sponsorship

What you’ll bring

All qualifications

Core experience

  • Bachelor's degree in Computer Science, Engineering, or a related field
  • 5-7+ years hands-on data engineering or architecture, with at least 2-4 years specifically focused on Azure Databricks, including Azure cloud technologies
  • 2-5 years experience in managing a team of data engineers, data scientists and/or analysts
  • Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and Scala
Qualification wording
Bachelor's degree in Computer Science, Engineering, or a related field
5-7+ years hands-on data engineering or architecture, with at least 2-4 years specifically focused on Azure Databricks, including Azure cloud technologies
2-5 years experience in managing a team of data engineers, data scientists and/or analysts
Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and Scala
Education & alternatives
Required Education - Bachelor's degree in Computer Science, Engineering, or a related field Required Experience
Apply at A.C. Coy

Posting record

Report an error

Open 5 monthsWe first saw this posting 171 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jun 3, 2026171 days ago
Recorded sightings
29
Last seen by us
Nov 22, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$155K–$227K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 3,272 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 171

Up longer than most. Similar jobs usually come down between day 8 and day 57.

Well past A.C. Coy’s usual: its jobs come down by about day 35.

From 9,984 similar postings that came down, and 7 of A.C. Coy’s. Coming down is not always a hire.

A.C. Coy is hiring

6 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • Scala
  • SQL
  • Azure
  • Databricks
  • Delta Lake
  • Hadoop
  • Kafka
  • MLflow
  • Spark
  • Trino
  • Airflow
  • PySpark
  • NoSQL
Where the posting names them
- Storage Optimization: Understanding file formats like Parquet, Avro, or ORC and compression techniques - Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and Scala - Infrastructure: Hands-on experience with Azure Cloud infrastructure, including Networking (VNETs), Key Vault, and Identity Management
- Pipeline Engineering: - Oversee the development of robust, scalable batch and streaming ETL/ELT pipelines using PySpark, Scala, and SQL and with minimal latency - Implement data transformations, enrichment, and quality checks using PySpark/Scala within the Databricks environment
- Oversee the development of robust, scalable batch and streaming ETL/ELT pipelines using PySpark, Scala, and SQL and with minimal latency - Implement data transformations, enrichment, and quality checks using PySpark/Scala within the Databricks environment - Integrate real-time and batch data sources using Apache Kafka and ADF
- Certifications (Preferred): Microsoft Certified: Azure Data Engineer Associate (DP-203), Databricks Certified Data Engineer Professional, or Azure Solutions Architect Expert - Database Architecture: Proficiency in both Relational (SQL) and NoSQL (Document, Key-Value, Graph, Columnar) databases. Develop and maintain data models and schemas to support data analysis and reporting requirements - Distributed Systems: Knowledge of frameworks like Apache Hadoop, Spark, or Presto/Trino for optimizing and handling massive data volumes and retrieval mechanisms, ensuring the efficient processing of large datasets
- Collaborate with business stakeholders, data scientists, and other team members to gather requirements and translate them into technical specifications - Lead the design, development and deployment of scalable and high-performance data pipelines using Azure Databricks; ensuring the data integrity, availability, efficient extraction, transformation, and loading of data from various sources into the Azure Databricks Data Warehouse - Collaborate with data scientists, analysts, and other engineering teams to deliver business-critical insights. Optimize pipeline performance, cost, and scalability in the Azure cloud environment
- Lead the design, development and deployment of scalable and high-performance data pipelines using Azure Databricks; ensuring the data integrity, availability, efficient extraction, transformation, and loading of data from various sources into the Azure Databricks Data Warehouse - Collaborate with data scientists, analysts, and other engineering teams to deliver business-critical insights. Optimize pipeline performance, cost, and scalability in the Azure cloud environment - Define best practices for data ingestion, processing, storage, and governance. Implement data quality checks and validation procedures to ensure the accuracy and integrity of data between various sources, including APIs, databases and streaming platforms
- Integrate real-time and batch data sources using Apache Kafka and ADF - Support large-scale data pipelines using Apache Spark on Databricks, Kafka, Stelo, and Azure Data Factory (ADF) - Data Governance & Security:
- Platform Integration: - Orchestrate workflows by integrating Databricks with other Azure services like Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure DevOps for CI/CD pipelines Qualifications
Required Experience - 5-7+ years hands-on data engineering or architecture, with at least 2-4 years specifically focused on Azure Databricks, including Azure cloud technologies - 2-5 years experience in managing a team of data engineers, data scientists and/or analysts
- 2-5 years experience in managing a team of data engineers, data scientists and/or analysts - Certifications (Preferred): Microsoft Certified: Azure Data Engineer Associate (DP-203), Databricks Certified Data Engineer Professional, or Azure Solutions Architect Expert - Database Architecture: Proficiency in both Relational (SQL) and NoSQL (Document, Key-Value, Graph, Columnar) databases. Develop and maintain data models and schemas to support data analysis and reporting requirements
- Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and Scala - Infrastructure: Hands-on experience with Azure Cloud infrastructure, including Networking (VNETs), Key Vault, and Identity Management - Big Data Tools: Deep knowledge of Apache Spark runtime internals, MLflow for MLOps, and orchestration tools like Airflow
- Performance Optimization & Tuning: - Tune Spark jobs and Databricks clusters to maximize throughput while maintaining cost efficiency through auto-scaling and cluster policies - Expertise in indexing strategies, query optimization, execution plans, and partitioning/sharding
- - Define the end-to-end Lakehouse architecture using Delta Lake, implementing medallion architecture (Bronze, Silver, Gold layers) for robust data processing - Familiarity with data modeling and schema design principles
- Database Architecture: Proficiency in both Relational (SQL) and NoSQL (Document, Key-Value, Graph, Columnar) databases. Develop and maintain data models and schemas to support data analysis and reporting requirements - Distributed Systems: Knowledge of frameworks like Apache Hadoop, Spark, or Presto/Trino for optimizing and handling massive data volumes and retrieval mechanisms, ensuring the efficient processing of large datasets - Storage Optimization: Understanding file formats like Parquet, Avro, or ORC and compression techniques
- Implement data transformations, enrichment, and quality checks using PySpark/Scala within the Databricks environment - Integrate real-time and batch data sources using Apache Kafka and ADF - Support large-scale data pipelines using Apache Spark on Databricks, Kafka, Stelo, and Azure Data Factory (ADF)
- Infrastructure: Hands-on experience with Azure Cloud infrastructure, including Networking (VNETs), Key Vault, and Identity Management - Big Data Tools: Deep knowledge of Apache Spark runtime internals, MLflow for MLOps, and orchestration tools like Airflow

Your next step

Complete your application on careers-accoy.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Job description

View original posting ↗

Overview

Location: Hybrid, Pittsburgh, PAJob Type: Full Time / PermanentWork Authorization: No C2C or Sponsorship

 

The A.C.Coy company has an immediate opening for a Data Platform Manager. This role will be responsible for designing, building, and optimizing enterprise wide data platforms within the Data Warehouse.

Responsibilities

  • Lead and mentor a team of data engineers, conducting code reviews and ensuring development standards
  • Support troubleshooting and incident management for data-related issues in production
  • Collaborate with business stakeholders, data scientists, and other team members to gather requirements and translate them into technical specifications
  • Lead the design, development and deployment of scalable and high-performance data pipelines using Azure Databricks; ensuring the data integrity, availability, efficient extraction, transformation, and loading of data from various sources into the Azure Databricks Data Warehouse
  • Collaborate with data scientists, analysts, and other engineering teams to deliver business-critical insights. Optimize pipeline performance, cost, and scalability in the Azure cloud environment
  • Define best practices for data ingestion, processing, storage, and governance. Implement data quality checks and validation procedures to ensure the accuracy and integrity of data between various sources, including APIs, databases and streaming platforms
  • Collaborate with data scientists and analysts to operationalize and deploy machine learning models
  • Architecture Design:
    • Define the end-to-end Lakehouse architecture using Delta Lake, implementing medallion architecture (Bronze, Silver, Gold layers) for robust data processing
    • Familiarity with data modeling and schema design principles
  • Pipeline Engineering:
    • Oversee the development of robust, scalable batch and streaming ETL/ELT pipelines using PySpark, Scala, and SQL and with minimal latency
    • Implement data transformations, enrichment, and quality checks using PySpark/Scala within the Databricks environment
    • Integrate real-time and batch data sources using Apache Kafka and ADF
    • Support large-scale data pipelines using Apache Spark on Databricks, Kafka, Stelo, and Azure Data Factory (ADF)
  • Data Governance & Security:
    • Implement Unity Catalog for unified governance, data security, fine-grained access control (RBAC), privacy measures, and data lineage tracking
  • Performance Optimization & Tuning:
    • Tune Spark jobs and Databricks clusters to maximize throughput while maintaining cost efficiency through auto-scaling and cluster policies
    • Expertise in indexing strategies, query optimization, execution plans, and partitioning/sharding
  • Platform Integration:
    • Orchestrate workflows by integrating Databricks with other Azure services like Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), and Azure DevOps for CI/CD pipelines

Qualifications

Required Education

  • Bachelor's degree in Computer Science, Engineering, or a related field

Required Experience

  • 5-7+ years hands-on data engineering or architecture, with at least 2-4 years specifically focused on Azure Databricks, including Azure cloud technologies
  • 2-5 years experience in managing a team of data engineers, data scientists and/or analysts
  • Certifications (Preferred): Microsoft Certified: Azure Data Engineer Associate (DP-203), Databricks Certified Data Engineer Professional, or Azure Solutions Architect Expert
  • Database Architecture: Proficiency in both Relational (SQL) and NoSQL (Document, Key-Value, Graph, Columnar) databases. Develop and maintain data models and schemas to support data analysis and reporting requirements
  • Distributed Systems: Knowledge of frameworks like Apache Hadoop, Spark, or Presto/Trino for optimizing and handling massive data volumes and retrieval mechanisms, ensuring the efficient processing of large datasets
  • Storage Optimization: Understanding file formats like Parquet, Avro, or ORC and compression techniques
  • Deep proficiency in programming languages: Python (specifically PySpark), SQL, PowerShell, and Scala
  • Infrastructure: Hands-on experience with Azure Cloud infrastructure, including Networking (VNETs), Key Vault, and Identity Management
  • Big Data Tools: Deep knowledge of Apache Spark runtime internals, MLflow for MLOps, and orchestration tools like Airflow

Demand for Data Leadership roles

New Data Leadership postings at the employers we follow are up 8% over the last 6 weeks compared with the 6 before.

Weekly new Data Leadership postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 751, the most 1,165, and the latest week had 775.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Leadership, by the work the posting describes.

Data leaders run data teams or design how a company's data fits together. Managers hire, set priorities and answer for whether the data work pays off; architects choose the systems and the shape of the data.

Expect years of hands-on data work, experience leading people or projects, and the ability to explain tradeoffs to executives.

Unlike a senior engineer or analyst, most of a data leader's week goes to people, planning and decisions rather than building.

US government figures for computer and information systems managers

Median yearly pay, May 2025
$175,140
Expected change, 2025 to 2035
15.8% more jobsagainst 3.5% for all jobs

The government has no code for data leaders, so these figures are for the closest group, computer and information systems managers, which includes data processing and data operations managers.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 11-3021.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Pittsburgh, PA

Overview Location: Hybrid, Pittsburgh, PAJob Type: Full Time / PermanentWork Authorization: No C2C or Sponsorship The A.C.Coy company has an immediate opening for a Data Platform Manager. This role will be responsible for designing, building, and optimizing enterprise wide data platforms within the Data Warehouse.
Work authorization
Overview Location: Hybrid, Pittsburgh, PAJob Type: Full Time / PermanentWork Authorization: No C2C or Sponsorship The A.C.Coy company has an immediate opening for a Data Platform Manager. This role will be responsible for designing, building, and optimizing enterprise wide data platforms within the Data Warehouse.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.