Pay
Lower than most similar jobs
$80K–$150K against $127K–$189K, the middle half of what similar US postings state.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Brooklyn, OH
Live, first seen by us 10 hours agoCOMPENSATION AND BENEFITS This position is eligible to earn a base salary in the range of $80,000.00 - $150,000.00 annually. Placement within the pay range may differ based upon various factors, including but not limited to skills, experience and geographic location. Compensation for this role also includes eligibility for incentive compensation which may include production, commission, and/or discretionary incentives. Please click here (https://www.key.com/about/careers/working-with-us/benefits.html) for a list of benefits for which this position is eligible.Read the full posting
Brooklyn, OH Full time R-42648Read the full posting
Design and run batch and incremental pipelines using Python, SQL and Cloud Composer
Implement and tune BigQuery datasets, tables and views for performance and cost
Write automated transformation workflows and data quality checks in Dataform
Maintain Terraform configurations and GitLab CI/CD pipelines across environments
Build secure API integrations with retry, error handling and rate limiting
Design, build, and support production batch and incremental pipelines using Python, SQL, and Cloud Composer
Implement and maintain BigQuery datasets, tables, views, and transformation workloads. Optimize partitioning, clustering, query performance, access, storage, and compute costs.
Write and deploy automated transformation workflows and data quality checks using Dataform.
Create and maintain repeatable Terraform configurations and GitLab CI/CD pipelines
Build secure integrations with enterprise APIs and source systems using appropriate authentication and credential management, incorporating retry, error handling, and rate-limiting patterns.
**Work Experience & Education** + Education: Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or equivalent practical experience. + Relevant Experience: 5+ years of hands-on data engineering experience building production cloud data pipelines and data warehouse solutions.
We found this posting on the National Labor Exchange. These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications. We count a repost when the same title and location comes back as a new listing within 60 days of the last one coming down. Some hiring systems expire listings on a schedule, so repost rates vary by system.
Target, Hybrid in Brooklyn Park, MN
Actively hiring, first seen by us 9 hours ago
City of New York, Brooklyn, NY, United States
Likely evergreen, first seen by us 5 days ago
Metropolitan Transportation Authority, Brooklyn, NY
Live, first seen by us 25 days ago
Lower than most similar jobs
$80K–$150K against $127K–$189K, the middle half of what similar US postings state.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 0
Early. Similar jobs usually come down between day 6 and day 56.
From 14,772 similar postings that came down. Coming down is not always a hire.
32 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
+ Data Pipeline & Orchestration: Proven experience designing and running production ELT/ETL pipelines, state management, incremental loading, and workflow scheduling with Cloud Composer or Apache Airflow. + Programming & Scripting: Strong hands-on programming skills in Python and Bash shell scripting for container and pipeline workflows. + API Ingestion: Practical experience extracting data from enterprise REST or GraphQL APIs, handling pagination, rate limits, OAuth flows, and integration with secret management systems.
**Essential Functions** + Data Pipeline Engineering: Design, build, and support production batch and incremental pipelines using Python, SQL, and Cloud Composer to collect and process data and telemetry from enterprise tools and source systems. + BigQuery Engineering & Optimization: Implement and maintain BigQuery datasets, tables, views, and transformation workloads. Optimize partitioning, clustering, query performance, access, storage, and compute costs.
**Required Technical Skills** + SQL & BigQuery: Advanced SQL proficiency with hands-on BigQuery experience managing datasets, partitioning, clustering, views, schema updates, access controls, and query optimization. + Data Pipeline & Orchestration: Proven experience designing and running production ELT/ETL pipelines, state management, incremental loading, and workflow scheduling with Cloud Composer or Apache Airflow.
+ API Ingestion: Practical experience extracting data from enterprise REST or GraphQL APIs, handling pagination, rate limits, OAuth flows, and integration with secret management systems. + Dataform / SQL Transformation: Hands-on experience developing modular data transformations, dependencies, and automated test assertions using Dataform or comparable SQL-based frameworks. + Terraform & GCP Infrastructure: Experience writing reusable Terraform modules to provision GCP data and IAM resources, including BigQuery, Cloud Storage, service accounts, Cloud Run, and Cloud Composer.
+ Data Pipeline Engineering: Design, build, and support production batch and incremental pipelines using Python, SQL, and Cloud Composer to collect and process data and telemetry from enterprise tools and source systems. + BigQuery Engineering & Optimization: Implement and maintain BigQuery datasets, tables, views, and transformation workloads. Optimize partitioning, clustering, query performance, access, storage, and compute costs. + Data Transformation & Testing: Write and deploy automated transformation workflows and data quality checks using Dataform.
+ Dataform / SQL Transformation: Hands-on experience developing modular data transformations, dependencies, and automated test assertions using Dataform or comparable SQL-based frameworks. + Terraform & GCP Infrastructure: Experience writing reusable Terraform modules to provision GCP data and IAM resources, including BigQuery, Cloud Storage, service accounts, Cloud Run, and Cloud Composer. + GitLab CI/CD: Practical experience maintaining GitLab CI/CD pipelines, including environment stages, automated testing, container builds, and branch management.
**Preferred Technical Skills** + Containerization: Experience packaging and running lightweight workloads using Docker, Cloud Build, and Cloud Run. + Developer Telemetry: Prior experience building reporting data models around software engineering tools, such as Jira, ServiceNow, GitLab.
We are seeking a Lead Data Engineer to support the design, implementation, maintenance, and lifecycle of enterprise data products starting with our DevOps Data Product transforming technology, operational, and business data into trusted, governed, and reusable insights. In this hands-on technical leadership role, you will partner with Data Product Owners, data modelers, data architects, platform engineers, technology teams, and business stakeholders to develop scalable data pipelines, reusable data models, cloud-native services, and deployment automation on Google Cloud Platform. This is a strong fit for someone who enjoys solving complex data and platform problems, improving data quality and reliability, reducing friction in the data delivery and pipeline lifecycle, and building standardized solutions that encourage broad adoption. The role offers the opportunity to influence data engineering standards, strengthen platform capabilities, and help shape a delivery ecosystem built for speed, quality, governance, and resilience.
+ Developer Telemetry: Prior experience building reporting data models around software engineering tools, such as Jira, ServiceNow, GitLab. + Streaming & Event Ingestion: Familiarity with event-driven data ingestion using Pub/Sub or Apache Beam / Google Cloud Dataflow. + Analytics & AI Readiness: Familiarity with engineering, operational, productivity, quality, cost, risk, or AI-related data.
+ Data Transformation & Testing: Write and deploy automated transformation workflows and data quality checks using Dataform. + CI/CD & Infrastructure as Code: Create and maintain repeatable Terraform configurations and GitLab CI/CD pipelines to automate testing, credential handling, and environment deployments across development, test, and production. + System Integration & Security: Build secure integrations with enterprise APIs and source systems using appropriate authentication and credential management, incorporating retry, error handling, and rate-limiting patterns.
+ SQL & BigQuery: Advanced SQL proficiency with hands-on BigQuery experience managing datasets, partitioning, clustering, views, schema updates, access controls, and query optimization. + Data Pipeline & Orchestration: Proven experience designing and running production ELT/ETL pipelines, state management, incremental loading, and workflow scheduling with Cloud Composer or Apache Airflow. + Programming & Scripting: Strong hands-on programming skills in Python and Bash shell scripting for container and pipeline workflows.
Complete your application on keybank.wd5.myworkdayjobs.com. The employer’s form will show what is required.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
COMPENSATION AND BENEFITS This position is eligible to earn a base salary in the range of $80,000.00 - $150,000.00 annually. Placement within the pay range may differ based upon various factors, including but not limited to skills, experience and geographic location. Compensation for this role also includes eligibility for incentive compensation which may include production, commission, and/or discretionary incentives. Please click here (https://www.key.com/about/careers/working-with-us/benefits.html) for a list of benefits for which this position is eligible.
Brooklyn, OH
**Work Location Category** + Hybrid (2+ days) COMPENSATION AND BENEFITS
Qualified individuals with disabilities or disabled veterans who are unable or limited in their ability to apply on this site may request reasonable accommodations by emailing HR_Compliance@keybank.com. \#LI-Hybrid KeyBank is an organization collectively committed to helping you unlock your potential and discover what truly drives you. Working here means sharing our purpose to help our clients, colleagues, and communities thrive. You’ll find genuinely supportive teammates, a flexible, inclusive work environment, challenging projects, accessible leaders, and opportunities to grow in your position and your career. For 200 years, Key has opened doors in our communities. Let us open one for you.
No clear work-authorization passage found. Eligibility is unconfirmed.
This posting reached us through a job exchange.
Read the full description ↓