Back to jobs

Senior Apache NiFi/Data Integration Engineer

Pay
$185,000–215,000/yearAnnual period assumed — pay source
Ideal Candidate The ideal candidate is not simply a NiFi user, but a NiFi architect and developer who can build custom processors from scratch, solve complex integration challenges, optimize enterprise-scale data flows, and lead onboarding efforts across multiple systems and organizations. This individual should be the technical expert that other engineers rely upon for advanced flow design, custom processor development, and enterprise data integration solution Salary Range for this opening $185-215K #CJ The Red Arch Solutions pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Determination of official compensation or salary relies on several factors including, but not limited to, level of position, job responsibilities, geographic location, scope of relevant work experience, educational background, certifications, contract-specific affordability, organizational requirements, alignment with local internal equity as well as alignment with market data.
Read the full posting
Work setting
Not stated
Employment
Not stated

Before you apply

Work authorization
Citizens onlyActive TS/SCI clearance required

What you’ll work on

Full posting
  • Design and maintain complex Apache NiFi data flows for data onboarding and integration

  • Develop custom Java NiFi processors, controller services, and reporting tasks

  • Optimize flow performance, throughput, and resource use in clustered environments

  • Implement metadata collection, tagging, and enrichment in onboarding workflows

  • Integrate authentication, encryption, and auditing into data pipelines

From the employer’s posting
Design, develop, test, deploy, and maintain complex Apache NiFi data flows supporting enterprise data onboarding and integration requirements.
Develop custom Apache NiFi processors, controller services, reporting tasks, and extensions using Java.
Optimize flow performance, throughput, latency, and resource utilization across clustered environments.
Implement metadata collection, tagging, and enrichment capabilities within data onboarding workflows.
Integrate authentication, authorization, encryption, and auditing capabilities into data pipelines.
Education & alternatives
Clearance- Active TS/SCI clearance required. Education (Desired) - Bachelor's degree in Computer Science, Engineering, Information Systems, or related technical discipline. DESIRED QUALIFICATIONS- Experience supporting DIA, NSA, NGA, or other Intelligence Community customers.
Apply at Red Arch Solutions

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 28, 202646 days ago
Recorded sightings
57
Last seen by us
Nov 13, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Higher than most similar jobs

$185K–$215K against $127K–$190K, the middle half of what similar US postings state.

From 2,239 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 46

Similar jobs usually come down between day 6 and day 56.

From 13,630 similar postings that came down. Coming down is not always a hire.

Red Arch Solutions is hiring

12 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring has slowed
  • Its jobs tend to stay up a long time
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Java
  • SQL
  • Docker
  • Elasticsearch
  • Kafka
  • Kubernetes
  • PostgreSQL
Where the posting names them
- Troubleshoot and resolve complex data movement, transformation, and processing issues. Advanced Processor Development- Develop custom Apache NiFi processors, controller services, reporting tasks, and extensions using Java. - Create specialized processors supporting: - Metadata extraction
- Secure Flow Design Exceptional Processor Development Skills Experience developing custom:- Java-based NiFi Processors - Controller Services
- Data Quality Validation Processors Technical Expertise Strong experience with:- Java - Spring Framework
- REST APIs - SQL - PostgreSQL
- Git - Docker - Kubernetes
- PostgreSQL - Elasticsearch - Kafka
- Message Queues - Kafka - File-Based Transfers
- Elasticsearch - Kafka - Git
- Docker - Kubernetes - Linux
- SQL - PostgreSQL - Elasticsearch

Your next step

Complete your application on redarchsolutions.applytojob.com. The employer’s form will show what is required.

Applying through JazzHR

  • No account needed: one application form on the employer’s applytojob.com page.

Already applied? Track this application

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 7% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 2. The fewest in a week was 860, the most 1,354, and the latest week had 1,335.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Job description

View original posting ↗

Apache NiFi Engineer / Data Integration Engineer

Position Overview
Red Arch Solutions is seeking a highly skilled Apache NiFi Engineer to support enterprise data onboarding, integration, and transformation initiatives within a Zero Trust environment. The successful candidate will design, develop, deploy, and maintain complex Apache NiFi data flows that enable secure, scalable, and reliable movement of mission and enterprise data across disparate systems.
This role requires deep expertise in Apache NiFi architecture, custom processor development, enterprise integration patterns, metadata management, data transformation, and workflow automation. The engineer will work closely with Data Stewards, Enterprise Architects, Zero Trust Core Services teams, Data Catalog personnel, system owners, and mission stakeholders to onboard new data sources and ensure compliance with enterprise data standards and security requirements.

KEY RESPONSIBILITIES
Apache NiFi Development & Engineering
  • Design, develop, test, deploy, and maintain complex Apache NiFi data flows supporting enterprise data onboarding and integration requirements.
  • Engineer scalable and fault-tolerant ingestion pipelines capable of processing structured, semi-structured, and unstructured data.
  • Develop reusable flow frameworks and integration patterns to accelerate onboarding activities.
  • Optimize flow performance, throughput, latency, and resource utilization across clustered environments.
  • Troubleshoot and resolve complex data movement, transformation, and processing issues.
Advanced Processor Development
  • Develop custom Apache NiFi processors, controller services, reporting tasks, and extensions using Java.
  • Create specialized processors supporting:
    • Metadata extraction
    • Schema validation
    • Data tagging
    • Attribute enrichment
    • Security classification enforcement
    • Data quality validation
    • API integrations
    • Workflow automation
  • Extend NiFi capabilities to support mission-specific onboarding requirements.
  • Develop shared processor libraries and reusable components.
Enterprise Data Integration
  • Integrate enterprise systems using:
    • REST APIs
    • SOAP Services
    • JDBC/ODBC Connections
    • Message Queues
    • Kafka
    • File-Based Transfers
    • Cloud Storage Services
  • Design data ingestion and routing strategies across multiple environments.
  • Support onboarding of mission and enterprise data assets into approved repositories and data services.
Metadata & Data Governance
  • Implement metadata collection, tagging, and enrichment capabilities within data onboarding workflows.
  • Support enterprise data catalog and governance initiatives.
  • Ensure onboarding workflows comply with metadata standards, taxonomy requirements, and stewardship processes.
  • Collaborate with Data Stewards and Data Owners to improve data quality and discoverability.
Zero Trust & Security Integration
  • Implement secure data movement patterns aligned with Zero Trust principles.
  • Integrate authentication, authorization, encryption, and auditing capabilities into data pipelines.
  • Coordinate with cybersecurity and Zero Trust teams to ensure compliance with enterprise security requirements.
  • Support Attribute-Based Access Control (ABAC) and policy-driven data access models.

REQUIRED QUALIFICATIONS
Experience
  • 12+ years experience. Experience working with users to help define their database use, data analytics, and the data user experience.
  • 12+ years of data integration, ETL, or enterprise middleware experience.
  • 8+ years of hands-on Apache NiFi development experience.
  • Experience designing and supporting large-scale enterprise data ingestion architectures.
  • Experience onboarding new data sources and integrating complex systems.
Advanced Apache NiFi Skills
Demonstrated expertise with:
  • NiFi Flow Design
  • Process Groups
  • Remote Process Groups
  • Site-to-Site Communications
  • Controller Services
  • Parameter Contexts
  • Flow Versioning
  • NiFi Registry
  • Clustered Deployments
  • Provenance Tracking
  • Back-Pressure Management
  • Flow Performance Tuning
  • Secure Flow Design
Exceptional Processor Development Skills
Experience developing custom:
  • Java-based NiFi Processors
  • Controller Services
  • Reporting Tasks
  • Custom APIs
  • Schema Validation Components
  • Metadata Extraction Processors
  • Content Parsing Processors
  • Security Enforcement Processors
  • Data Quality Validation Processors
Technical Expertise
Strong experience with:
  • Java
  • Spring Framework
  • JSON
  • XML
  • Avro
  • Parquet
  • REST APIs
  • SQL
  • PostgreSQL
  • Elasticsearch
  • Kafka
  • Git
  • Docker
  • Kubernetes
  • Linux
Security & Architecture
Understanding of:
  • Zero Trust Architecture
  • Data-Centric Security
  • PKI
  • TLS
  • Identity and Access Management
  • Data Governance
  • Metadata Management
  • Enterprise Architecture Principles
Clearance
  • Active TS/SCI clearance required.
Education (Desired) 
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related technical discipline.
DESIRED QUALIFICATIONS
  • Experience supporting DIA, NSA, NGA, or other Intelligence Community customers.
  • Experience integrating with Data Catalog platforms and metadata repositories.
  • Experience with ontology, taxonomy, and semantic tagging implementations.
  • Familiarity with Cloudera DataFlow, Hortonworks DataFlow, or large-scale NiFi deployments.
  • Experience developing automated onboarding workflows.
  • Knowledge of enterprise data governance and stewardship processes.
  • Experience operating in highly regulated or classified environments.
Ideal Candidate
The ideal candidate is not simply a NiFi user, but a NiFi architect and developer who can build custom processors from scratch, solve complex integration challenges, optimize enterprise-scale data flows, and lead onboarding efforts across multiple systems and organizations. This individual should be the technical expert that other engineers rely upon for advanced flow design, custom processor development, and enterprise data integration solution


Salary Range for this opening $185-215K #CJ

The Red Arch Solutions pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Determination of official compensation or salary relies on several factors including, but not limited to, level of position, job responsibilities, geographic location, scope of relevant work experience, educational background, certifications, contract-specific affordability, organizational requirements, alignment with local internal equity as well as alignment with market data.

Red Arch Solutions Benefits Snapshot:

  • 100% paid employee healthcare premiums. CareFirst Advantage Best in Class Benefits.
  • HaloScripts Concierge prescription medication service
  • Generous PTO.
  • 10 % 401K 6% match vested day one and up to 4% profit sharing contribution.
  • Annualized bonus compensation.
  • Spot bonuses for hard work.
  • Tuition reimbursement.
  • 529 College Saving Plan.
  • College Loan Pay Back Program.
  • 11 Paid Federal Holidays
  • Generous Referral Bonuses.

Red Arch Solutions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Have more questions about Red Arch? Email us at Careers@RedArchSolutions.com

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Ideal Candidate The ideal candidate is not simply a NiFi user, but a NiFi architect and developer who can build custom processors from scratch, solve complex integration challenges, optimize enterprise-scale data flows, and lead onboarding efforts across multiple systems and organizations. This individual should be the technical expert that other engineers rely upon for advanced flow design, custom processor development, and enterprise data integration solution Salary Range for this opening $185-215K #CJ The Red Arch Solutions pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Determination of official compensation or salary relies on several factors including, but not limited to, level of position, job responsibilities, geographic location, scope of relevant work experience, educational background, certifications, contract-specific affordability, organizational requirements, alignment with local internal equity as well as alignment with market data.
Location & working pattern

Reston, VA

- Process Groups - Remote Process Groups - Site-to-Site Communications
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.