Back to jobs

Data Engineer - AWS/Databricks

Pay
Pay not listedSimilar roles state $127K–$190K
Work setting
Remote — work setting source
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment
Not stated

What you’ll work on

Full posting
  • Build and maintain scalable PySpark data pipelines in Databricks notebooks

  • Design Delta Lake tables for ACID compliance, partition pruning and query speed

  • Develop ETL and ELT workflows feeding a centralized data warehouse

  • Optimize pipeline performance through partitioning, caching and broadcast joins

  • Automate deployment of data assets with CI/CD tools such as GitLab or Jenkins

From the employer’s posting
Build and maintain scalable PySpark-based data pipelines in Databricks notebooks
Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance
Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.
Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.
automate deployment with CI/CD tools such as GitLab or Jenkins

Before you apply

Work authorization
US citizens onlyMust be US Citizen with an ability to obtain and maintain US Suitability

What you’ll bring

All qualifications

Core experience

  • 2+ years of experience in data engineering and Agile analytics
  • 2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data
  • 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics
  • 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks
  • Experience with data quality, validation frameworks, and storage optimization strategies
Qualification wording
2+ years of experience in data engineering and Agile analytics
2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data
1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics
1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks
Experience with data quality, validation frameworks, and storage optimization strategies
Education & alternatives
- Experience with data quality, validation frameworks, and storage optimization strategies - BA or BS degree Clearance Requirement:
Apply at Acuity

Posting record

Report an error

Open 3 monthsWe first saw this posting 112 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records
Live
First seen by us
Jul 28, 2026112 days ago
Recorded sightings
69
Last seen by us
Nov 17, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$190K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,383 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 112

Up longer than most. Similar jobs usually come down between day 6 and day 56.

Well past Acuity’s usual: its jobs come down by about day 18.

From 14,070 similar postings that came down, and 5 of Acuity’s. Coming down is not always a hire.

Acuity is hiring

11 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Takes jobs down at a usual pace
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • SQL
  • AWS
  • Databricks
  • Delta Lake
  • S3
  • Spark
  • PySpark
Where the posting names them
- Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture. - Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. - Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.
Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization. Why Acuity?
- Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. - Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control. - Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.
- Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins. - Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs. - Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.
- 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics - 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks - Experience with data quality, validation frameworks, and storage optimization strategies
Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. Responsibilities - Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. - Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.
- Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. - Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets. - Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.

Your next step

Complete your application on careers-myacuity.icims.com. The employer’s form will show what is required.

Applying through iCIMS

  • You start with your email. New applicants then create a login, and returning ones sign in.
  • Upload your resume before you fill anything in: iCIMS fills some profile fields from it.
  • Check your status on the employer’s iCIMS Dashboard, under Past Job Submittals.

Already applied? Track this application

Has Acuity posted this job before?

Yes. We’ve followed one other Data Engineer - AWS/Databricks job there since July 2026. It is still up.

  1. RestonStill up after 126 days, first seen Jul 15
  2. This jobUp 112 days so far, first seen Jul 28

Job description

View original posting ↗

Overview

Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization.

Why Acuity?

Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions.

Responsibilities

  • Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data.
  • Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.

  • Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.

  • Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices.

  • Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.

  • Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.

  • Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins.

  • Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs.

  • Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.

  • Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic.

  • Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams.

Qualifications

  • 2+ years of experience in data engineering and Agile analytics
  • 2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data
  • 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics
  • 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks
  • Experience with data quality, validation frameworks, and storage optimization strategies
  • BA or BS degree

Clearance Requirement:

  • Must be US Citizen with an ability to obtain and maintain US Suitability

 

 

 

Min

USD $90,000.00/Yr.

Max

USD $100,000.00/Yr.

Salary Range

The salary range for this position represents Acuity's good faith estimate of the compensation for this job title at the time of posting. Final compensation will be determined based on factors including, but not limited to, the candidate's qualifications, experience, education, certifications, skills, geographic location, contract requirements, applicable labor categories, and, where applicable, contract award and funding.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 14% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 861, the most 1,353, and the latest week had 1,022.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Reston, VA

Working pattern and location restrictions need checking in the full posting.

Work authorization
Clearance Requirement: - Must be US Citizen with an ability to obtain and maintain US Suitability Min

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.