Back to jobs

Ab Initio Data Engineer

Pay
$45–53/hour — pay source
Job ID:26-23682 Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment) Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
Read the full posting
Work setting
Not stated
Employment
Full-time — employment source
Employment type in the employer’s posting: FULL_TIME
From the employer’s posting

What you’ll work on

Full posting
  • Design, develop and maintain complex ETL graphs in Ab Initio GDE

  • Architect end-to-end integration across RDBMS, mainframe, flat files and queues

  • Optimize graph performance through parallelism, partitioning and checkpointing

  • Troubleshoot production job failures and implement fixes

  • Build CDC and near-real-time data pipelines

From the employer’s posting
Design, develop, and maintain complex ETL graphs using Ab Initio GDE
Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
Optimize graph performance — parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing
Troubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtime
Design and implement CDC (Change Data Capture) and near-real-time data pipelines

Before you apply

Employer’s visa record
211 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.
Education & alternatives
Key Requirements and Technology Experience: - Must have skills: - Ab Initio, GDE and Unix/Linux - Bachelor’s degree in Computer Science, Engineering, or related field - 7+ years of ETL development experience, with 5+ years specifically in Ab Initio
Apply at Pyramid Consulting

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 18, 20263 days ago
Recorded sightings
4
Last seen by us
Nov 21, 2026
Employer says posted
Aug 3, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$189K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 56.

From 14,770 similar postings that came down. Coming down is not always a hire.

Pyramid Consulting is hiring

56 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • COBOL
  • Shell
  • SQL
  • Ab Initio
  • Db2
  • Hadoop
  • Kafka
  • Kubernetes
Where the posting names them
- Strong debugging and performance-tuning skills for large-volume data processing - Experience with mainframe data integration (COBOL copybooks, VSAM, flat files) - Exposure to Kubernetes, openshift
- Strong SQL skills and experience with major RDBMS (DB2) - Experience with Unix/Linux shell scripting - Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
- Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS) - Strong SQL skills and experience with major RDBMS (DB2) - Experience with Unix/Linux shell scripting
Immediate need for a talented Ab Initio Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite). Please review the job description below and contact me ASAP if you are interested. Job ID:26-23682
Job ID:26-23682 Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment) - Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
- Optimize graph performance — parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing - Lead development using Ab Initio components: Co>Operating System, EME (Enterprise Meta>Environment), Conduct>It, Data Profiler, Continuous Flows - Own metadata management and data lineage within EME
- Define coding standards, review peer-developed graphs, and enforce best practices - Mentor junior/mid-level Ab Initio developers - Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design
- Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design Key Requirements and Technology Experience: - Must have skills: - Ab Initio, GDE and Unix/Linux - Bachelor’s degree in Computer Science, Engineering, or related field
- Bachelor’s degree in Computer Science, Engineering, or related field - 7+ years of ETL development experience, with 5+ years specifically in Ab Initio - Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
- 7+ years of ETL development experience, with 5+ years specifically in Ab Initio - Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It - Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
- Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It - Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS) - Strong SQL skills and experience with major RDBMS (DB2)
- Exposure to Kubernetes, openshift - Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures - Knowledge of API-based or streaming integration (Kafka)
- Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas) - Experience with Kafka - Strong debugging and performance-tuning skills for large-volume data processing
- Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures - Knowledge of API-based or streaming integration (Kafka) - Prior experience as a technical lead or in a client-facing architecture role
- Experience with mainframe data integration (COBOL copybooks, VSAM, flat files) - Exposure to Kubernetes, openshift - Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures

Your next step

Complete your application on jobs.sprockets.ai. The employer’s form will show what is required.

Already applied? Track this application

Job description

View original posting ↗

Immediate need for a talented Ab Initio Data Engineer. This is a 06+ Months Contract opportunity with long-term potential and is located in Berkeley Heights, NJ (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:26-23682 

Pay Range: $45 - $53/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:
  • Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment)
  • Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
  • Optimize graph performance — parallelism, partitioning (broadcast, hash, range), layout tuning, checkpointing
  • Lead development using Ab Initio components: Co>Operating System, EME (Enterprise Meta>Environment), Conduct>It, Data Profiler, Continuous Flows
  • Own metadata management and data lineage within EME
  • Design and implement CDC (Change Data Capture) and near-real-time data pipelines
  • Troubleshoot production job failures, perform root-cause analysis, and implement fixes with minimal downtime
  • Define coding standards, review peer-developed graphs, and enforce best practices
  • Mentor junior/mid-level Ab Initio developers
  • Collaborate with data architects, DBAs, and business analysts to translate requirements into technical design
Key Requirements and Technology Experience:
  • Must have skills: - Ab Initio, GDE and Unix/Linux
  • Bachelor’s degree in Computer Science, Engineering, or related field
  • 7+ years of ETL development experience, with 5+ years specifically in Ab Initio
  • Strong hands-on expertise with Ab Initio GDE, Co>Op, EME, and Conduct>It
  • Deep understanding of parallel processing concepts and Ab Initio partitioning/multi-file system (MFS)
  • Strong SQL skills and experience with major RDBMS (DB2)
  • Experience with Unix/Linux shell scripting
  • Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
  • Experience with Kafka
  • Strong debugging and performance-tuning skills for large-volume data processing
  • Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
  • Exposure to Kubernetes, openshift 
  • Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
  • Knowledge of API-based or streaming integration (Kafka)
  • Prior experience as a technical lead or in a client-facing architecture role
  • Strong analytical and problem-solving skills for complex data issues
  • Ability to lead design discussions and drive technical consensus
  • Effective mentorship and knowledge-sharing across the team
  • Clear communication with both technical and business stakeholders
  • Good Communication skills
  • 5 days Work from Office at Berkley Heights, NJ
  • Team Player
  • Ability to work in a changing environment
  • Strong problem solving and analytical skills
  • Ability to work independently or within a team
  • Manage day-to-day challenges and communicate developmental risks with the technical team
Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can 

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Job ID:26-23682 Pay Range: $45 - $53/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Design, develop, and maintain complex ETL graphs using Ab Initio GDE (Graphical Development Environment) Architect end-to-end data integration solutions spanning multiple source/target systems (RDBMS, mainframe, flat files, message queues)
Location & working pattern

Berkley Heights, NJ, US

- Exposure to Kubernetes, openshift - Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures - Knowledge of API-based or streaming integration (Kafka)
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.