Senior Data Engineer
Location not identified
- Pay
$160,000–180,000per Annually — pay source
Professional Development Training Reimbursement Salary Range: $160K to $180K per Annually
Read the full posting- Work setting
Remote stated — work setting source
Listed location: Remote
Read the full posting- Employment
Full-time — employment source
Job Title: Senior Data Engineer Location: Remote Position Type: Full-Time Clearance Required: Secret Clearance About the company: At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies
Read the full posting
What you’ll work on
Full postingArchitect, build and manage an AWS lakehouse on Apache Iceberg, S3 and Glue Catalog
Develop and optimize Apache Spark pipelines on EMR and Kubernetes
Design event-driven data ingestion using S3 events and Amazon SQS
Orchestrate ETL pipelines with Apache Airflow and manage infrastructure with Terraform
From the employer’s posting
Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog.
Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments.
Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS.
Orchestrate data workflows and ETL pipelines using Apache Airflow.
Tools in this posting
- Python
- Scala
- SQL
- AWS
- dbt
- Delta Lake
- Grafana
- Iceberg
- Kubernetes
- S3
- Spark
- Terraform
- Trino
- Airflow
Source — Tool mentions in context
- Expertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew. - Strong proficiency in Python or Scala and advanced SQL development. - Experience with open table formats such as Apache Iceberg (preferred) or Delta Lake.
- Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS. - Optimize query performance across Athena, Trino, and Spark SQL environments. - Orchestrate data workflows and ETL pipelines using Apache Airflow.
- Experience with open table formats such as Apache Iceberg (preferred) or Delta Lake. - Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL. - Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures.
About the company: At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies Job Summary: We are seeking a Senior Data Engineer to support a United States Air Force (USAF) program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams. Key Responsibilities:- Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog.
Job Summary: We are seeking a Senior Data Engineer to support a United States Air Force (USAF) program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams. Key Responsibilities:- Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog. - Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments.
- Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL. - Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures. - Experience with Apache Airflow for workflow orchestration.
- Familiarity with data catalog, metadata management, lineage, and governance tools. - AWS Data Analytics Certification and/or Certified Kubernetes Administrator (CKA). - Prior DoD, USAF, or Federal Government data platform experience.
- Experience with Trino administration and performance optimization. - Knowledge of dbt or similar data transformation frameworks. - Experience with Helm and GitOps deployment methodologies.
- Strong proficiency in Python or Scala and advanced SQL development. - Experience with open table formats such as Apache Iceberg (preferred) or Delta Lake. - Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL.
- Experience working with Kubernetes environments. - Experience developing dashboards and data products using Grafana or similar visualization platforms. - Strong understanding of data quality, data governance, lineage, and access control frameworks.
- Experience with Helm and GitOps deployment methodologies. - Experience evaluating and implementing modern data visualization platforms beyond Grafana. - Familiarity with data catalog, metadata management, lineage, and governance tools.
- Strong attention to detail regarding data quality, governance, lineage, security, and operational reliability. Preferred Skills:- Experience operating and maintaining Apache Iceberg tables at enterprise scale. - Experience with Trino administration and performance optimization.
Key Responsibilities:- Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog. - Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments. - Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS.
- Proficiency with Terraform and Infrastructure as Code (IaC). - Experience working with Kubernetes environments. - Experience developing dashboards and data products using Grafana or similar visualization platforms.
- Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments. - Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS. - Optimize query performance across Athena, Trino, and Spark SQL environments.
- 8+ years of professional experience in Data Engineering or large-scale data platform development. - Expertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew. - Strong proficiency in Python or Scala and advanced SQL development.
- Orchestrate data workflows and ETL pipelines using Apache Airflow. - Manage infrastructure deployment and automation using Terraform. - Develop, publish, monitor, and maintain data products and analytical dashboards.
- Experience with Apache Airflow for workflow orchestration. - Proficiency with Terraform and Infrastructure as Code (IaC). - Experience working with Kubernetes environments.
Preferred Skills:- Experience operating and maintaining Apache Iceberg tables at enterprise scale. - Experience with Trino administration and performance optimization. - Knowledge of dbt or similar data transformation frameworks.
- Optimize query performance across Athena, Trino, and Spark SQL environments. - Orchestrate data workflows and ETL pipelines using Apache Airflow. - Manage infrastructure deployment and automation using Terraform.
- Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures. - Experience with Apache Airflow for workflow orchestration. - Proficiency with Terraform and Infrastructure as Code (IaC).
Posting record
Report an error- Status in our records
- Live
- First seen by us
- Oct 8, 2026 · 14 days ago
- Recorded sightings
- 18
- Last seen by us
- Oct 23, 2026
These dates show when we found the listing. Check the employer’s website to confirm it is still accepting applications.
Your next step
- Have your resume and examples of relevant work ready.
- Check the listed location, eligibility and core experience before starting.
Complete your application on vivsofttechnologiesfa.applytojob.com. The employer’s form will show what is required.
Already applied? Track this application
Job description
Job Title: Senior Data Engineer
Location: Remote
Position Type: Full-Time
Clearance Required: Secret Clearance
About the company:
At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies
Job Summary:
We are seeking a Senior Data Engineer to support a United States Air Force (USAF) program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams.
Key Responsibilities:
Required Skills:
Preferred Skills:
Benefits:
Salary Range: $160K to $180K per Annually
Location: Remote
Position Type: Full-Time
Clearance Required: Secret Clearance
About the company:
At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies
Job Summary:
We are seeking a Senior Data Engineer to support a United States Air Force (USAF) program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams.
Key Responsibilities:
- Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog.
- Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments.
- Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS.
- Optimize query performance across Athena, Trino, and Spark SQL environments.
- Orchestrate data workflows and ETL pipelines using Apache Airflow.
- Manage infrastructure deployment and automation using Terraform.
- Develop, publish, monitor, and maintain data products and analytical dashboards.
- Implement data quality, governance, lineage, access controls, and cost management best practices.
- Create technical documentation, architectural designs, and operational runbooks.
- Provide technical leadership and mentorship to junior engineering team members.
Required Skills:
- Must possess an active Secret Clearance
- 8+ years of professional experience in Data Engineering or large-scale data platform development.
- Expertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew.
- Strong proficiency in Python or Scala and advanced SQL development.
- Experience with open table formats such as Apache Iceberg (preferred) or Delta Lake.
- Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL.
- Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures.
- Experience with Apache Airflow for workflow orchestration.
- Proficiency with Terraform and Infrastructure as Code (IaC).
- Experience working with Kubernetes environments.
- Experience developing dashboards and data products using Grafana or similar visualization platforms.
- Strong understanding of data quality, data governance, lineage, and access control frameworks.
- Excellent technical leadership, mentoring, and stakeholder communication skills.
- Ability to translate business, operational, and analytics requirements into scalable data platform solutions.
- Strong collaboration skills with Data Scientists, AI Engineers, Cloud Engineers, and business stakeholders.
- Proven ability to lead technical discussions and mentor junior engineers.
- Excellent written and verbal communication skills.
- Strong attention to detail regarding data quality, governance, lineage, security, and operational reliability.
Preferred Skills:
- Experience operating and maintaining Apache Iceberg tables at enterprise scale.
- Experience with Trino administration and performance optimization.
- Knowledge of dbt or similar data transformation frameworks.
- Experience with Helm and GitOps deployment methodologies.
- Experience evaluating and implementing modern data visualization platforms beyond Grafana.
- Familiarity with data catalog, metadata management, lineage, and governance tools.
- AWS Data Analytics Certification and/or Certified Kubernetes Administrator (CKA).
- Prior DoD, USAF, or Federal Government data platform experience.
- Experience supporting AI/ML, data science, or advanced analytics workloads in cloud environments.
Benefits:
- Comprehensive Medical, Dental, and Vision Plans (Healthcare benefits are 100% employer-paid for employees only)
- Life Insurance
- Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays)
- 401K Retirement Plan with employer match
- Professional Development Training Reimbursement
Salary Range: $160K to $180K per Annually
Source details
Source notes
Source excerptsSelected passages from the saved posting. Check the full description for conditions and exceptions.
- Pay
Professional Development Training Reimbursement Salary Range: $160K to $180K per Annually
- Location & working pattern
Remote
Job Title: Senior Data Engineer Location: Remote Position Type: Full-Time Clearance Required: Secret Clearance About the company: At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies
- Work authorization
No clear work-authorization passage found. Eligibility is unconfirmed.
See how this role fits your experience
Add your resume to compare the role’s scope, tools and requirements with your experience.