Back to jobs

Databricks Platform & Database Engineer

Pay
$136,000–177,000/year · BaseLocation-specific pay — pay source
The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies. Base Compensation: $136,000 - $177,000 annually. #LI-CH1
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: Full time
From the employer’s posting

What you’ll work on

Full posting
  • Administer Databricks workspaces on AWS, including clusters, access, and Unity Catalog

  • Monitor and right-size clusters and SQL warehouses for performance and cost

  • Provision, patch, back up, and fail over relational and nonrelational databases

  • Build Terraform infrastructure-as-code for Databricks and database resources

  • Lead root cause analysis on incidents in 24/7 production environments

From the employer’s posting
Deploy, administer, and maintain Databricks workspaces on AWS
Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost
Manage provisioning, patching, backups, replication, failover, version upgrades, and cross-platform migrations
Develop IaC solutions using Terraform for Databricks workspaces, AWS RDS, Aurora, and supporting resources
Support SLA-driven 24/7 production environments; lead root cause analysis, troubleshoot incidents

Before you apply

Work authorization
Must already have the right to work in the USWe welcome all qualified candidates who are currently eligible to work full-time in the United States to apply

What you’ll bring

All qualifications

Core experience

  • Bachelor’s Degree required from an accredited, not for profit, in person, university or college.
  • Experience with cost optimization initiatives.
  • Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
  • Experience supporting 24/7 operational environments
  • 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership
  • Experience with data governance frameworks, compliance practices, and cloud cost optimization

Preferred experience

  • Familiarity with AI governance frameworks, model lineage, auditability, and compliance
  • Experience with kafka or other real-time streaming platforms, Postgres/RDBMS
  • Experience with Snowflake Administration
  • Experience working with and managing large consumer datasets to derive insights
Qualification wording
Bachelor’s Degree required from an accredited, not for profit, in person, university or college.
Experience with cost optimization initiatives.
Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
Experience supporting 24/7 operational environments
5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership
Experience with data governance frameworks, compliance practices, and cloud cost optimization
Familiarity with AI governance frameworks, model lineage, auditability, and compliance
Experience with kafka or other real-time streaming platforms, Postgres/RDBMS
Experience with Snowflake Administration
Experience working with and managing large consumer datasets to derive insights
Education & alternatives
Basic Qualifications - Bachelor’s Degree required from an accredited, not for profit, in person, university or college. - A track record of commitment to prior employers.
Apply at CoStar

Posting record

Report an error

Open 3 monthsWe first saw this posting 102 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Aug 11, 2026102 days ago
Recorded sightings
253
Last seen by us
Nov 15, 2026
Employer says posted
Jul 31, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

In line with similar jobs

$136K–$177K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 102

Up longer than most. Similar jobs usually come down between day 6 and day 56.

Well past CoStar’s usual: its jobs come down by about day 46.

From 14,771 similar postings that came down, and 54 of CoStar’s. Coming down is not always a hire.

CoStar is hiring

36 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Data Engineer hiring has slowed
  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Databricks
  • Delta Lake
  • DynamoDB
  • Kafka
  • Looker
  • MLflow
  • MongoDB
  • MySQL
  • NoSQL
  • PostgreSQL
  • Power BI
  • S3
  • Snowflake
  • SQL Server
  • Terraform
  • PySpark
  • PyTorch
  • scikit-learn
  • TensorFlow
Where the posting names them
- Strong relational database engineering skills: schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL - Advanced SQL and proficiency in PySpark and Python - Infrastructure-as-Code experience with Terraform; CI/CD pipeline management
We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. We are looking for a Databricks Platform & Database Engineer with hands-on experience in enterprise Databricks environments on AWS and traditional database engineering spanning relational and non-relational systems. In this role, you will serve as the primary owner of our Databricks environment on AWS responsible for administration, automation, governance, and platform reliability end to end. Alongside that, you will manage, optimize, automate, and govern a broader portfolio of relational databases (SQL Server, Aurora, PostgreSQL, MySQL) and nonrelational data stores across both AWS cloud and on-premises data centers. CoStar is investing heavily in artificial intelligence to accelerate software delivery, improve platform observability, automate research and business workflows, enhance product experiences through intelligent agents and skills, and improve data quality across enterprise systems. Successful candidates will demonstrate a willingness to learn, adopt, and apply AI technologies responsibly to solve complex business and engineering challenges.
- Lead platform upgrades, workspace migrations, and full environment lifecycle management - Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost; analyze Spark executor logs and query plans to diagnose and resolve bottlenecks - Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services
- Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services - Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers. - Design, implement, and administer relational and non-relational databases such as SQL Server, Aurora, PostgreSQL, MySQL, and DynamoDB across AWS (RDS/Aurora) and on-premises data centers
- Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers. - Design, implement, and administer relational and non-relational databases such as SQL Server, Aurora, PostgreSQL, MySQL, and DynamoDB across AWS (RDS/Aurora) and on-premises data centers - Manage provisioning, patching, backups, replication, failover, version upgrades, and cross-platform migrations between cloud and on-premises environments
- Build and maintain CI/CD workflows for platform configuration and pipeline code - Implement proactive monitoring and alerting across Databricks jobs, pipelines, clusters, SQL warehouses, and all database instances - Implement and enforce cluster policies, SQL warehouse governance, and workspace hardening.
- Implement proactive monitoring and alerting across Databricks jobs, pipelines, clusters, SQL warehouses, and all database instances - Implement and enforce cluster policies, SQL warehouse governance, and workspace hardening. - Manage Databricks audit logs, lineage, and compliance reporting
- Deep expertise in Databricks platform administration: Unity Catalog, workspace security, cluster management, and Auto Loader on AWS - Strong relational database engineering skills: schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL - Advanced SQL and proficiency in PySpark and Python
Responsibilities - Deploy, administer, and maintain Databricks workspaces on AWS, including workspace configuration, network settings, access management, Runtime versions, cluster configurations, libraries, and init scripts across dev, staging, and production - Manage Unity Catalog objects (catalogs, schemas, tables, external locations) and administer workspace security: users, groups, service principals, permissions, and enterprise identity provider integrations
- Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost; analyze Spark executor logs and query plans to diagnose and resolve bottlenecks - Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services - Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers.
- Apply database security best practices including encryption at rest and in transit, access control, and auditing - Develop IaC solutions using Terraform for Databricks workspaces, AWS RDS, Aurora, and supporting resources - Automate operational tasks: cluster lifecycle, database provisioning, job scheduling, and backup management across cloud and on-premises environments
- Knowledge of data governance and compliance best practices. - Deep expertise in Databricks platform administration: Unity Catalog, workspace security, cluster management, and Auto Loader on AWS - Strong relational database engineering skills: schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL
Databricks Platform & Database Engineer<br> Job Description
- Implement and enforce cluster policies, SQL warehouse governance, and workspace hardening. - Manage Databricks audit logs, lineage, and compliance reporting - Support SLA-driven 24/7 production environments; lead root cause analysis, troubleshoot incidents, and author operational runbooks
- Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures. - 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership - Proven, hands-on experience administering enterprise Databricks environments
- 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership - Proven, hands-on experience administering enterprise Databricks environments - Collaborate with cross-functional teams: Work closely with business analysts, data scientists, DBAs, and DevOps engineers to ensure successful data platform implementations.
- Familiarity with ML tooling: MLflow, TensorFlow, PyTorch, or Scikit-learn - Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
- Working knowledge of Data Visualization tools like Looker and PowerBI - Working knowledge of non-relational databases: DynamoDB, MongoDB, or equivalent NoSQL platforms - Familiarity with AI governance frameworks, model lineage, auditability, and compliance
- requirements for ML systems - Experience with kafka or other real-time streaming platforms, Postgres/RDBMS - Experience with Snowflake Administration
Preferred Qualifications - Working knowledge of Data Visualization tools like Looker and PowerBI - Working knowledge of non-relational databases: DynamoDB, MongoDB, or equivalent NoSQL platforms
- Experience implementing access controls, data privacy protections, and monitoring for AI workloads. - Familiarity with ML tooling: MLflow, TensorFlow, PyTorch, or Scikit-learn - Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake
- Experience with kafka or other real-time streaming platforms, Postgres/RDBMS - Experience with Snowflake Administration - Experience working with and managing large consumer datasets to derive insights
- Advanced SQL and proficiency in PySpark and Python - Infrastructure-as-Code experience with Terraform; CI/CD pipeline management - Experience with cost optimization initiatives.

Your next step

Complete your application on costar.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

Databricks Platform & Database Engineer

<br>

Job Description

<br>

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces.  Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. 

We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors.  We continue that effort today and are always working to improve and drive innovation.  This is how we deliver for our customers, our employees, and investors.  By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

We are looking for a Databricks Platform & Database Engineer with hands-on experience in enterprise Databricks environments on AWS and traditional database engineering spanning relational and non-relational systems. In this role, you will serve as the primary owner of our Databricks environment on AWS responsible for administration, automation, governance, and platform reliability end to end. Alongside that, you will manage, optimize, automate, and govern a broader portfolio of relational databases (SQL Server, Aurora, PostgreSQL, MySQL) and nonrelational data stores across both AWS cloud and on-premises data centers.

CoStar is investing heavily in artificial intelligence to accelerate software delivery, improve platform observability, automate research and business workflows, enhance product experiences through intelligent agents and skills, and improve data quality across enterprise systems. Successful candidates will demonstrate a willingness to learn, adopt, and apply AI technologies responsibly to solve complex business and engineering challenges.

This position is located in Arlington, VA and is in office Monday through Thursday with work from home on Friday.

Responsibilities 

  • Deploy, administer, and maintain Databricks workspaces on AWS, including workspace configuration, network settings, access management, Runtime versions, cluster configurations, libraries, and init scripts across dev, staging, and production
  • Manage Unity Catalog objects (catalogs, schemas, tables, external locations) and administer workspace security: users, groups, service principals, permissions, and enterprise identity provider integrations
  • Lead platform upgrades, workspace migrations, and full environment lifecycle management
  • Monitor, optimize and right‑sizing clusters, SQL warehouses, and job compute for performance and cost; analyze Spark executor logs and query plans to diagnose and resolve bottlenecks
  • Support data ingestion from relational and non-relational sources into Databricks via AWS, DMS or native Lakeflow ingestion services
  • Lead the design and implementation of end-to-end data workflows, covering the reliable distribution of curated data to downstream systems including SQL Server, DynamoDB, S3, and other enterprise data consumers.
  • Design, implement, and administer relational and non-relational databases such as SQL Server, Aurora, PostgreSQL, MySQL, and DynamoDB across AWS (RDS/Aurora) and on-premises data centers
  • Manage provisioning, patching, backups, replication, failover, version upgrades, and cross-platform migrations between cloud and on-premises environments
  • Apply database security best practices including encryption at rest and in transit, access control, and auditing
  • Develop IaC solutions using Terraform for Databricks workspaces, AWS RDS, Aurora, and supporting resources
  • Automate operational tasks: cluster lifecycle, database provisioning, job scheduling, and backup management across cloud and on-premises environments
  • Build and maintain CI/CD workflows for platform configuration and pipeline code
  • Implement proactive monitoring and alerting across Databricks jobs, pipelines, clusters, SQL warehouses, and all database instances
  • Implement and enforce cluster policies, SQL warehouse governance, and workspace hardening.
  • Manage Databricks audit logs, lineage, and compliance reporting
  • Support SLA-driven 24/7 production environments; lead root cause analysis, troubleshoot incidents, and author operational runbooks
  • Partner with data scientists, business analysts, DBAs, and DevOps engineers to deliver platform implementations and respond to ad-hoc data needs

Basic Qualifications 

  • Bachelor’s Degree required from an accredited, not for profit, in person, university or college.  
  • A track record of commitment to prior employers.
  • Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures.
  • 5+ years of experience in database engineering or data platform roles, across both relational/non-relational database administration and Databricks platform ownership
  • Proven, hands-on experience administering enterprise Databricks environments
  • Collaborate with cross-functional teams: Work closely with business analysts, data scientists, DBAs, and DevOps engineers to ensure successful data platform implementations.
  • Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions
  • Knowledge of data governance and compliance best practices.
  • Deep expertise in Databricks platform administration: Unity Catalog, workspace security, cluster management, and Auto Loader on AWS
  • Strong relational database engineering skills: schema design, query optimization, indexing, stored procedures, replication, and failover across SQL Server, Aurora, PostgreSQL, and/or MySQL
  • Advanced SQL and proficiency in PySpark and Python
  • Infrastructure-as-Code experience with Terraform; CI/CD pipeline management
  • Experience with cost optimization initiatives.
  • Experience supporting 24/7 operational environments
  • Experience with data governance frameworks, compliance practices, and cloud cost optimization

Preferred Qualifications 

  • Working knowledge of Data Visualization tools like Looker and PowerBI
  • Working knowledge of non-relational databases: DynamoDB, MongoDB, or equivalent NoSQL platforms
  • Familiarity with AI governance frameworks, model lineage, auditability, and compliance
  • requirements for ML systems
  • Experience with kafka or other real-time streaming platforms, Postgres/RDBMS
  • Experience with Snowflake Administration
  • Experience working with and managing large consumer datasets to derive insights
  • Experience with FinOps / cloud cost optimization
  • Experience implementing access controls, data privacy protections, and monitoring for AI workloads.
  • Familiarity with ML tooling: MLflow, TensorFlow, PyTorch, or Scikit-learn
  • Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake


We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply.  However, please note that CoStar Group is not able to provide visa sponsorship for this position.

The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.

Base Compensation: $136,000 - $177,000 annually.

#LI-CH1

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

<br>

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing

About CoStar

People
About 8,000 in 2025, up 21% from the year before.Annual report (SEC Form 10-K)
Company
Listed as CSGP.
H-1B visas
6 approved for new hires in fiscal 2025.US Citizenship and Immigration Services

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies. Base Compensation: $136,000 - $177,000 annually. #LI-CH1
Location & working pattern

US-VA Arlington

- Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.
Work authorization
- Understanding of Lakehouse AI architecture and how ML pipelines integrate with Unity Catalog and Delta Lake We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.