Back to jobs

Data Engineer 2 - Guidewire

New Jersey - Edison, NJ 08837

Live, first seen by us 40 days ago
Pay
$86,800–160,700/yearAnnual period assumed. Location-specific pay — pay source
Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions. The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.
Read the full posting
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Design, build and optimize ELT pipelines into a Delta Lakehouse

  • Design and maintain data models and schemas that ensure data quality

  • Build pipelines and embeddings for unstructured data used in Generative AI

  • Build dashboards and reports that deliver business insights

  • Monitor pipelines, troubleshoot data issues and run root cause analysis

From the employer’s posting
Design, develop, and optimize ELT pipelines to ingest, transform, and load data into a Delta Lakehouse platform.
Design, Develop and maintain data models and schemas ensuring data quality and integrity.
Build and maintain data pipelines to process structured and unstructured data (like documents and text) for Generative AI tasks, including creating embeddings and working with vector databases to support AI search features.
Build and maintain dashboards and reports delivering actionable business insights.
Conduct root cause analysis for system failures and performance events; drive continuous improvements in enterprise data integration pipelines.

Before you apply

Employer’s visa record
4 H-1B petitions approved in fiscal 2024 and 2025For the employer as a whole. This posting doesn’t say whether the role is sponsored. US Citizenship and Immigration Services.

What you’ll bring

All qualifications

Core experience

  • Bachelor’s degree in relevant field of study required(e.g.
  • Strong understanding of CI/CD pipelines and experience in Agile development environments.
  • Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets.
  • Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
  • 5+ years of progressive work experience in IT or a related field required.
  • Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly.
Qualification wording
Bachelor’s degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.)
Strong understanding of CI/CD pipelines and experience in Agile development environments.
Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets.
Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
5+ years of progressive work experience in IT or a related field required.
Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly.
Education & alternatives
Education and Experience: - Bachelor’s degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.) - 5+ years of progressive work experience in IT or a related field required.

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 12, 202640 days ago
Recorded sightings
40
Last seen by us
Nov 21, 2026
Employer says posted
Apr 24, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

Lower than most similar jobs

$86.8K–$161K against $127K–$189K, the middle half of what similar US postings state.

From 2,448 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 40

Similar jobs usually come down between day 6 and day 56.

From 14,767 similar postings that came down. Coming down is not always a hire.

Greater New York Mutual Insurance Company is hiring

2 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • SQL
  • Azure
  • Databricks
  • MySQL
  • Oracle
  • Power BI
  • Spark
  • SQL Server
Where the posting names them
- 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required. - In-depth understanding of relational database systems (e.g., Oracle, SQL Server, MySQL), including their features and performance optimization strategies. - Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire.
- Proficient in Microsoft Azure services, including: - Azure SQL Database - Azure Data Lake Storage Gen2
- Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire. - 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required. - 2+ years of experience working with Power BI or other leading data visualization and reporting tools required.
- Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required. - Proficient in Microsoft Azure services, including: - Azure SQL Database
- Azure SQL Database - Azure Data Lake Storage Gen2 - Azure Event Grid
- Azure Data Lake Storage Gen2 - Azure Event Grid - Azure Key Vault
- Azure Event Grid - Azure Key Vault - Strong understanding of CI/CD pipelines and experience in Agile development environments.
- Data Modeling - Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions - Collaboration with cross-functional groups
- 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required. - 2+ years of experience working with Power BI or other leading data visualization and reporting tools required. - Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required.
- 2+ years of experience working with Power BI or other leading data visualization and reporting tools required. - Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required. - Proficient in Microsoft Azure services, including:

Your next step

Complete your application on www.paycomonline.net. The employer’s form will show what is required.

Applying through Paycom

  • The application asks you to sign in or create a Paycom account with the employer.

Already applied? Track this application

Job description

View original posting ↗

Description

Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.

Position Summary: Data Engineer with previous experience in the insurance domain, design, build, and maintain scalable data pipelines and models that power analytics and Generative AI initiatives. The Data Engineer will collaborate closely with analysts and engineers, to understand data needs, develop efficient solutions, and ensure the integrity, performance, and security of our data systems.

Essential Duties and Responsibilities:

  • Analyze integration and system requirements by understanding business needs and designing effective data solutions, particularly for Guidewire Policy, Billing Center and Commercial P&C data domains.
  • Design, develop, and optimize ELT pipelines to ingest, transform, and load data into a Delta Lakehouse platform.
  • Design, Develop and maintain data models and schemas ensuring data quality and integrity.
  • Build and maintain dashboards and reports delivering actionable business insights.
  • Monitor pipeline and storage performance; troubleshoot and resolve data issues promptly.
  • Collaborate with cross-functional teams, including analysts and business users, to deliver end-to-end insurance data solutions.
  • Implement data governance, security, and compliance standards across platforms.
  • Conduct root cause analysis for system failures and performance events; drive continuous improvements in enterprise data integration pipelines.
  • Create and manage testing procedures (unit, scenario, end-to-end) to ensure pipeline reliability.
  • Stay current with emerging technologies and recommend improvements to workflows.
  • Mentor team members on data engineering tools, Guidewire data model concepts and best practices.
  • Build and maintain data pipelines to process structured and unstructured data (like documents and text) for Generative AI tasks, including creating embeddings and working with vector databases to support AI search features.
  • Prepare and clean large datasets to ensure high-quality inputs for training and fine-tuning Generative AI models.
  • Collaborate with AI and data science teams to understand data requirements and deliver scalable solutions that support model training and inference.
  • Implement processes to enrich data with metadata and context to improve AI model accuracy and relevance.
  • Optimize data storage and retrieval methods to support fast, low-latency responses for AI-powered applications.
  • Monitor data workflows for Generative AI projects, troubleshooting issues, and ensure continuous pipeline performance.

Qualifications

Education and Experience:

  • Bachelor’s degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.)
  • 5+ years of progressive work experience in IT or a related field required.
  • 3+ years of experience in data engineering and analytics, with a solid foundation in data architecture and integration, including hands-on work with complex enterprise P& C Insurance data models required.
  • 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required.
  • In-depth understanding of relational database systems (e.g., Oracle, SQL Server, MySQL), including their features and performance optimization strategies.
  • Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire.
  • 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required.
  • 2+ years of experience working with Power BI or other leading data visualization and reporting tools required.
  • Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required.
  • Proficient in Microsoft Azure services, including:
    • Azure SQL Database
    • Azure Data Lake Storage Gen2
    • Azure Event Grid
    • Azure Key Vault
  • Strong understanding of CI/CD pipelines and experience in Agile development environments.
  • Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly.
  • Capable of managing multiple priorities with strong attention to detail and follow-through.
  • Working knowledge of Generative AI frameworks and use cases in data engineering is a plus.
  • Knowledge of data governance, metadata management, and data quality frameworks.
  • Understanding of data security and privacy principles, including encryption, anonymization, and access control mechanisms.
  • Proficient in Microsoft Office Suites

Skills:

  • Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets.
  • Data Modeling
  • Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
  • Collaboration with cross-functional groups
  • Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions.

The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs.  Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.

Demand for Data Engineer roles

New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.

Weekly new Data Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 845, the most 1,344, and the latest week had 1,007.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay
Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions. The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.
Location & working pattern

New Jersey - Edison, NJ 08837

Description Remote position with the ability to travel to our NJ and NY locations up to 25% of the time. Position Summary: Data Engineer with previous experience in the insurance domain, design, build, and maintain scalable data pipelines and models that power analytics and Generative AI initiatives. The Data Engineer will collaborate closely with analysts and engineers, to understand data needs, develop efficient solutions, and ensure the integrity, performance, and security of our data systems.
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.