Back to jobs

Senior Data Engineer

US-VA Richmond - CoStar Tower

Open 3 months, first seen by us 92 days ago
Pay
$133,000–172,000/year · BaseLocation-specific pay — pay source
The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies. Base Compensation: $133,000 - $172,000 annually. We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting

We are seeking a Senior Data Engineer to join a new team building our next generation of data warehousing pipelines and ecosystem in the finance tech organization.

This position is in Richmond, VA and has a work schedule of Monday through Thursday in office and Friday work from home.

  • Design, build, and maintain scalable data pipelines and data platforms

  • Develop and optimize ETL/ELT processes for large, complex datasets

  • Collaborate with engineering, product, DevOps and DBA teams to deliver production systems

  • Contribute to technical design decisions and mentor other engineers

From the employer’s posting
We are seeking a Senior Data Engineer to join a new team building our next generation of data warehousing pipelines and ecosystem in the finance tech organization. Initially this role will focus on building a data migration and transformation process for external systems for use in our enterprise contracting system. This will include receiving data from multiple data sources of varying format, frequency and type. You will create applications to process it in a repeatable, customizable and recurring state to simplify the conversion process of our financial data across systems and acquisitions both today and in the future. You will also help standardize our data environment across our billing systems to allow for greater visibility into patterns, errors and optimizations to our business, consisting of billions of dollars of payments a year.
This position is in Richmond, VA and has a work schedule of Monday through Thursday in office and Friday work from home.
Design, build, and maintain scalable data pipelines and data platforms
Develop and optimize ETL/ELT processes for large, complex datasets
Collaborate with engineering, product, DevOps and DBA teams to deliver production systems
Contribute to technical design decisions and mentor other engineers on the team

Before you apply

Work authorization
Must already have the right to work in the USWe welcome all qualified candidates who are currently eligible to work full-time in the United States to apply

What you’ll bring

All qualifications

Core experience

  • Bachelor's degree required from an accredited, not-for-profit, in-person college/university
  • 5+ years of data engineering experience, including experience setting technical direction on projects and influencing design across a team
  • Hands-on experience building batch and incremental ingestion pipelines from multiple heterogeneous external sources (REST/GraphQL APIs, flat-file and SFTP feeds, third-party data vendors, and database replication/CDC)
  • Demonstrated experience normalizing inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution
  • Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
  • Experience with agentic engineering with AI-assisted development tools (Claude Code or similar) to accelerate software delivery

Preferred experience

  • Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
  • 401(K) retirement plan with matching contributions
  • Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
  • Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
Qualification wording
Bachelor's degree required from an accredited, not-for-profit, in-person college/university
5+ years of data engineering experience, including experience setting technical direction on projects and influencing design across a team
Hands-on experience building batch and incremental ingestion pipelines from multiple heterogeneous external sources (REST/GraphQL APIs, flat-file and SFTP feeds, third-party data vendors, and database replication/CDC)
Demonstrated experience normalizing inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution
Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
Experience with agentic engineering with AI-assisted development tools (Claude Code or similar) to accelerate software delivery
Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
401(K) retirement plan with matching contributions
Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
Education & alternatives
Basic Qualifications: - Bachelor's degree required from an accredited, not-for-profit, in-person college/university - Track record of commitment to prior employers
Apply at CoStar

Posting record

Report an error

Open 3 monthsWe first saw this posting 92 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 21, 202692 days ago
Recorded sightings
228
Last seen by us
Nov 15, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$133K–$172K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 92

Up longer than most. Similar jobs usually come down between day 6 and day 56.

Well past CoStar’s usual: its jobs come down by about day 46.

From 14,770 similar postings that came down, and 54 of CoStar’s. Coming down is not always a hire.

CoStar is hiring

36 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring has slowed
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • C#
  • Java
  • Python
  • Scala
  • SQL
  • Airbyte
  • Alation
  • AWS
  • Azure
  • BigQuery
  • Collibra
  • Databricks
  • dbt
  • Delta Lake
  • Fivetran
  • GCP
  • Iceberg
  • Kafka
  • Qlik
  • Redshift
  • S3
  • Snowflake
  • Spark
  • Terraform
  • Airflow
  • Dagster
  • Great Expectations
Where the posting names them
- Demonstrated experience normalizing inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution - Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus proficiency in Python, Scala, Java, or C#/.NET - Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory)
- Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization - AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# / .NET - AI/ML and feature-engineering pipelines and ability to apply AI assist or agentic workflows for code generation, review and root-cause analysis
Preferred Qualifications: - Production-scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi) - Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
- Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent) - Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink) - Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation)
- Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink) - Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation) - Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
- Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory) - Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP) - Experience with agentic engineering with AI-assisted development tools (Claude Code or similar) to accelerate software delivery
- Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus proficiency in Python, Scala, Java, or C#/.NET - Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory) - Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
- Production-scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi) - Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent) - Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)

Your next step

Complete your application on costar.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Has CoStar posted this job before?

Yes. We’ve followed one other Senior Data Engineer job there since June 2026. It is still up.

  1. Place not statedStill up after 170 days, first seen Jun 5
  2. This jobUp 93 days so far, first seen Aug 21

Job description

View original posting ↗

Senior Data Engineer

<br>

Job Description

<br>

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.  

We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.    

Role Description:

We are seeking a Senior Data Engineer to join a new team building our next generation of data warehousing pipelines and ecosystem in the finance tech organization. Initially this role will focus on building a data migration and transformation process for external systems for use in our enterprise contracting system. This will include receiving data from multiple data sources of varying format, frequency and type. You will create applications to process it in a repeatable, customizable and recurring state to simplify the conversion process of our financial data across systems and acquisitions both today and in the future. You will also help standardize our data environment across our billing systems to allow for greater visibility into patterns, errors and optimizations to our business, consisting of billions of dollars of payments a year.

This position is in Richmond, VA and has a work schedule of Monday through Thursday in office and Friday work from home.

Responsibilities:

  • Design, build, and maintain scalable data pipelines and data platforms
  • Develop and optimize ETL/ELT processes for large, complex datasets
  • Collaborate with engineering, product, DevOps and DBA teams to deliver production systems
  • Contribute to technical design decisions and mentor other engineers on the team

Basic Qualifications:

  • Bachelor's degree required from an accredited, not-for-profit, in-person college/university
  • Track record of commitment to prior employers
  • 5+ years of data engineering experience, including experience setting technical direction on projects and influencing design across a team
  • Hands-on experience building batch and incremental ingestion pipelines from multiple heterogeneous external sources (REST/GraphQL APIs, flat-file and SFTP feeds, third-party data vendors, and database replication/CDC)
  • Demonstrated experience normalizing inconsistent third-party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution
  • Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus proficiency in Python, Scala, Java, or C#/.NET
  • Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory)
  • Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
  • Experience with agentic engineering with AI-assisted development tools (Claude Code or similar) to accelerate software delivery

Preferred Qualifications:

  • Production-scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi)
  • Experience with a modular transformation framework and tested, version-controlled models (dbt, SQLMesh, or equivalent)
  • Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near-real-time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
  • Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation)
  • Master data management, entity resolution, or record-linkage tooling, including address and geospatial standardization
  • AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# / .NET
  • AI/ML and feature-engineering pipelines and ability to apply AI assist or agentic workflows for code generation, review and root-cause analysis

What’s in it for you?   

When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.  

We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, and tuition reimbursement. 

Our benefits package includes (but is not limited to):  

  • Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug  
  • Life, legal, and supplementary insurance  
  • Virtual and in person mental health counseling services for individuals and family  
  • Commuter and parking benefits  
  • 401(K) retirement plan with matching contributions  
  • Employee stock purchase plan  
  • Paid time off  
  • Tuition reimbursement  
  • On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes 
  • Access to CoStar Group’s Employee Resource Groups
  • Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks  

The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.

Base Compensation: $133,000 - $172,000 annually.

We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.

#LI-CH1

<br>

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

About CoStar

People
About 8,000 in 2025, up 21% from the year before.Annual report (SEC Form 10-K)
Company
Listed as CSGP.
H-1B visas
6 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies. Base Compensation: $133,000 - $172,000 annually. We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
Location & working pattern

US-VA Richmond - CoStar Tower

- Tuition reimbursement - On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes - Access to CoStar Group’s Employee Resource Groups
More source context
Base Compensation: $133,000 - $172,000 annually. We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. #LI-CH1
Work authorization
Base Compensation: $133,000 - $172,000 annually. We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. #LI-CH1

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.