Pay
Lower than most similar jobs
$86.8K–$161K against $127K–$189K, the middle half of what similar US postings state.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
New Jersey - Edison, NJ 08837
Live, first seen by us 40 days agoStrong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions. The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.Read the full posting
Design, build and optimize ELT pipelines into a Delta Lakehouse
Design and maintain data models and schemas that ensure data quality
Build pipelines and embeddings for unstructured data used in Generative AI
Build dashboards and reports that deliver business insights
Monitor pipelines, troubleshoot data issues and run root cause analysis
Design, develop, and optimize ELT pipelines to ingest, transform, and load data into a Delta Lakehouse platform.
Design, Develop and maintain data models and schemas ensuring data quality and integrity.
Build and maintain data pipelines to process structured and unstructured data (like documents and text) for Generative AI tasks, including creating embeddings and working with vector databases to support AI search features.
Build and maintain dashboards and reports delivering actionable business insights.
Conduct root cause analysis for system failures and performance events; drive continuous improvements in enterprise data integration pipelines.
Bachelor’s degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.)
Strong understanding of CI/CD pipelines and experience in Agile development environments.
Strong understanding of the Insurance Domain and Experience using Guidewire CDA data model to build use case specific datasets.
Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions
5+ years of progressive work experience in IT or a related field required.
Demonstrated ability to troubleshoot system issues, identify root causes, and implement effective solutions quickly.
Education and Experience: - Bachelor’s degree in relevant field of study required(e.g. computer science, data science, data analytics, applied mathematics, etc.) - 5+ years of progressive work experience in IT or a related field required.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Lower than most similar jobs
$86.8K–$161K against $127K–$189K, the middle half of what similar US postings state.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 40
Similar jobs usually come down between day 6 and day 56.
From 14,767 similar postings that came down. Coming down is not always a hire.
2 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- 2+ years of experience with data-centric projects within the Guidewire ecosystem, including working with Guidewire Policy Center and related data structures required. - In-depth understanding of relational database systems (e.g., Oracle, SQL Server, MySQL), including their features and performance optimization strategies. - Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire.
- Proficient in Microsoft Azure services, including: - Azure SQL Database - Azure Data Lake Storage Gen2
- Solid grasp of ETL processes, data pipeline architectures, and data integration techniques, particularly for operational source systems such as Guidewire. - 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required. - 2+ years of experience working with Power BI or other leading data visualization and reporting tools required.
- Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required. - Proficient in Microsoft Azure services, including: - Azure SQL Database
- Azure SQL Database - Azure Data Lake Storage Gen2 - Azure Event Grid
- Azure Data Lake Storage Gen2 - Azure Event Grid - Azure Key Vault
- Azure Event Grid - Azure Key Vault - Strong understanding of CI/CD pipelines and experience in Agile development environments.
- Data Modeling - Expertise in Azure Databricks, Azure Data Factory, Apache Spark, and data pipeline development for scalable data engineering solutions - Collaboration with cross-functional groups
- 2+ years of hands-on experience with Azure Databricks, Azure data factory including developing and optimizing data pipelines using Apache Spark required. - 2+ years of experience working with Power BI or other leading data visualization and reporting tools required. - Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required.
- 2+ years of experience working with Power BI or other leading data visualization and reporting tools required. - Proven expertise with Apache Spark, Delta Lakehouse, and data warehousing technologies required. - Proficient in Microsoft Azure services, including:
Complete your application on www.paycomonline.net. The employer’s form will show what is required.
Already applied? Track this application
Remote position with the ability to travel to our NJ and NY locations up to 25% of the time.
Position Summary: Data Engineer with previous experience in the insurance domain, design, build, and maintain scalable data pipelines and models that power analytics and Generative AI initiatives. The Data Engineer will collaborate closely with analysts and engineers, to understand data needs, develop efficient solutions, and ensure the integrity, performance, and security of our data systems.
The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
Strong analytical and problem-solving skills, with the ability to translate business requirements into practical data solutions. The salary range for this role is $86,800 - $160,700. The listed annual salary range posted for this position is subject to change and may vary depending on performance, education, experience, skills, geographic location, travel requirements, demonstrated proficiency in the competencies required for the role and business needs. Base pay is just one component of GNY’s total compensation package for employees. Other rewards include eligibility for an annual discretionary bonus based on performance.
New Jersey - Edison, NJ 08837
Description Remote position with the ability to travel to our NJ and NY locations up to 25% of the time. Position Summary: Data Engineer with previous experience in the insurance domain, design, build, and maintain scalable data pipelines and models that power analytics and Generative AI initiatives. The Data Engineer will collaborate closely with analysts and engineers, to understand data needs, develop efficient solutions, and ensure the integrity, performance, and security of our data systems.
No clear work-authorization passage found. Eligibility is unconfirmed.