Acuity

Data Engineer - AWS/Databricks

Reston, VA

Pay: Pay not listedSimilar roles state $127K–$190K
Work setting: Remote — work setting source
Work setup in the employer’s posting: TELECOMMUTE
From the employer’s posting
Employment: Not stated

Apply at Acuity

What you’ll work on

Full posting

Build and maintain scalable PySpark data pipelines in Databricks notebooks
Design Delta Lake tables for ACID compliance, partition pruning and query speed
Develop ETL and ELT workflows feeding a centralized data warehouse
Optimize pipeline performance through partitioning, caching and broadcast joins
Automate deployment of data assets with CI/CD tools such as GitLab or Jenkins

From the employer’s posting

Build and maintain scalable PySpark-based data pipelines in Databricks notebooks

Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance

Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.

Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.

automate deployment with CI/CD tools such as GitLab or Jenkins

What you’ll bring

All qualifications

Core experience

2+ years of experience in data engineering and Agile analytics
2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data
1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics
1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks
Experience with data quality, validation frameworks, and storage optimization strategies

Qualification wording

2+ years of experience in data engineering and Agile analytics

2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data

1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics

1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks

Experience with data quality, validation frameworks, and storage optimization strategies

Education & alternatives

- Experience with data quality, validation frameworks, and storage optimization strategies - BA or BS degree Clearance Requirement:

Tools in this posting

SQL
AWS
Databricks
Delta Lake
S3
Spark
PySpark

Source

- Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture. - Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. - Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.

Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization. Why Acuity?

- Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. - Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control. - Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.

- Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins. - Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs. - Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.

- 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics - 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks - Experience with data quality, validation frameworks, and storage optimization strategies

Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions. Responsibilities - Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. - Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.

- Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. - Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets. - Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.

Posting record

Report an error

Open 3 monthsWe first saw this posting 95 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.

Status in our records: Live
First seen by us: Jul 28, 2026 · 95 days ago
Recorded sightings: 54
Last seen by us: Nov 1, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

Your next step

Have your resume and examples of relevant work ready.
Check the listed location, eligibility and core experience before starting.
Ask the employer about the pay range before committing time to the process.

Complete your application on careers-myacuity.icims.com. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Overview

Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization.

Why Acuity?

Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers’ critical missions.

Responsibilities

Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data.
Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets.
Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture.
Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices.
Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control.
Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning.
Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins.
Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs.
Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows.
Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic.
Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams.

Qualifications

2+ years of experience in data engineering and Agile analytics
2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data
1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics
1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks
Experience with data quality, validation frameworks, and storage optimization strategies
BA or BS degree

Clearance Requirement:

Must be US Citizen with an ability to obtain and maintain US Suitability

Min

USD $90,000.00/Yr.

Max

USD $100,000.00/Yr.

Salary Range

The salary range for this position represents Acuity's good faith estimate of the compensation for this job title at the time of posting. Final compensation will be determined based on factors including, but not limited to, the candidate's qualifications, experience, education, certifications, skills, geographic location, contract requirements, applicable labor categories, and, where applicable, contract award and funding.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Reston, VA

Working pattern and location restrictions need checking in the full posting.

Work authorization

Clearance Requirement: - Must be US Citizen with an ability to obtain and maintain US Suitability Min

Open source at careers-myacuity.icims.com ↗Read the full description ↓

See how this role fits your experience

Add your resume to compare the role’s scope, tools and requirements with your experience.

Upload resume Add LinkedIn