Back to jobs

Data Engineer

Pay
Pay not listedSimilar roles state $127K–$190K
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Lead design and delivery of a MySQL to Databricks Lakebase migration

  • Design and build data pipelines using Fivetran, Databricks and AWS

  • Build prototypes and reference implementations, then harden them for production

  • Integrate SAP data through SAP BTP and BDC Connect with non-SAP data

  • Establish engineering standards for CI/CD, testing, observability, security and cost

From the employer’s posting
Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase
Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services.
Build prototypes and reference implementations, then work with the client to harden them for production.
Integrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products.
Establish engineering standards: CI/CD, testing, observability, security, and cost control.
Apply at IBM

Posting record

Report an error

Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.

Status in our records
Live
First seen by us
Nov 1, 20263 days ago
Recorded sightings
2
Last seen by us
Nov 2, 2026
Employer says posted
Oct 28, 2026

We found this posting on the National Labor Exchange. These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Pay

$127K–$190K is typical

The middle half of what similar US postings state. This one doesn’t list pay.

From 2,133 postings in the last year. Stated ranges, not salaries paid.

Time since we first saw it

Day 3

Early. Similar jobs usually come down between day 6 and day 54.

From 10,782 similar postings that came down. Coming down is not always a hire.

IBM is hiring

272 open jobs

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
  • SQL
  • AWS
  • Databricks
  • Delta Lake
  • Fivetran
  • GCP
  • Iceberg
  • Kafka
  • MLflow
  • MySQL
  • PostgreSQL
  • SAP
  • Spark
  • Terraform
Where the posting names them
• Advanced hands-on expertise in data engineering and solution architecture, with demonstrated ability to design and deliver complex data solutions. • Strong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python, including large-scale batch and streaming workloads. • Experience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns.
**Your role and responsibilities** Data Engineer embedded with the client's teams to design and deliver hands-on solutions on the AWS/Databricks platform. The role combines architecture and engineering, and you will build and prove solutions with the client. Work includes re-engineering legacy data workloads and supporting data migration from MySQL to Databricks Lakebase. Responsibilities
• Work onsite or embedded with client teams to understand business problems and turn them into working technical solutions. • Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services. • Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation.
• Manage and maintain large data repositories, ensuring scalability and performance. • Create data solutions on cloud-native platforms (AWS, with GCP for ML/GenAI), tailored to client requirements. • Collaborate with clients to understand their needs and deliver customized data solutions that meet their business objectives.
• Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U. • Exposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP. • Experience with Git-based version control and branching strategies for data workloads.
• Experience with Git-based version control and branching strategies for data workloads. • Experience in the utilities or energy industry, with relevant Databricks and/or AWS certification IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
• Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services. • Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation. • Integrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products.
• Must be able to travel 4 days per week (mandatory). • Databricks Certified Data Engineer or Machine Learning Professional. • Advanced hands-on expertise in data engineering and solution architecture, with demonstrated ability to design and deliver complex data solutions.
**Preferred technical and professional experience** • Experience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies. • Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U.
• Experience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns. • Experience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines. • Hands-on experience designing scalable data platforms and pipelines using technologies such as Kafka, Amazon EventBridge, or Amazon SQS, along with Terraform and CI/CD practices.
• Strong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python, including large-scale batch and streaming workloads. • Experience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns. • Experience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines.
• Experience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines. • Hands-on experience designing scalable data platforms and pipelines using technologies such as Kafka, Amazon EventBridge, or Amazon SQS, along with Terraform and CI/CD practices. **Preferred technical and professional experience**
• Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation. • Integrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products. • Build prototypes and reference implementations, then work with the client to harden them for production.
• Experience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies. • Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U. • Exposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP.

Your next step

Complete your application on www.ibm.com. The employer’s form will show what is required.

Already applied? Track this application

Has IBM posted this job before?

Yes. We’ve followed 24 other Data Engineer jobs there since November 2026. All 24 are still up.

  1. BostonStill up after 4 days, first seen Nov 1
  2. AustinStill up after 4 days, first seen Nov 1
  3. HoustonStill up after 4 days, first seen Nov 1
  4. Research Triangle ParkStill up after 4 days, first seen Nov 1
  5. DallasStill up after 4 days, first seen Nov 1
  6. ParamusStill up after 4 days, first seen Nov 1
  7. New YorkStill up after 4 days, first seen Nov 1
  8. AustinStill up after 4 days, first seen Nov 1
  9. This jobUp 4 days so far, first seen Nov 1

Large employers often post one title for several teams, so these can be separate openings.

About the role

We file this job under Data Engineer, by the work the posting describes.

Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.

Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.

An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.

US government figures for database architects

Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs

The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.

Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.

Job description

View original posting ↗

**Introduction** A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. **Your role and responsibilities** Data Engineer embedded with the client's teams to design and deliver hands-on solutions on the AWS/Databricks platform. The role combines architecture and engineering, and you will build and prove solutions with the client. Work includes re-engineering legacy data workloads and supporting data migration from MySQL to Databricks Lakebase. Responsibilities • Work onsite or embedded with client teams to understand business problems and turn them into working technical solutions. • Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services. • Lead technical design and delivery for migrating a Tier-1 application from MySQL to Databricks Lakebase, including schema re-design, data migration, cutover, and validation. • Integrate SAP data through SAP BTP and BDC Connect, non-SAP data, and design domain centric data products. • Build prototypes and reference implementations, then work with the client to harden them for production. • Support data and AI use cases, including integration with GCP-based ML/GenAI components. • Establish engineering standards: CI/CD, testing, observability, security, and cost control. • Coach client and delivery team members, and communicate status, risks, and design decisions to stakeholders. • Design end-to-end data solutions across multiple platforms, applying industry standards and best practices to meet client needs. • Lead the development of data platform architectures, including cognitive components and unstructured data technologies, annotation, and related data and analytics. • Manage and maintain large data repositories, ensuring scalability and performance. • Create data solutions on cloud-native platforms (AWS, with GCP for ML/GenAI), tailored to client requirements. • Collaborate with clients to understand their needs and deliver customized data solutions that meet their business objectives. This job can be performed from anywhere in the US **Required technical and professional expertise** • Must be able to travel 4 days per week (mandatory). • Databricks Certified Data Engineer or Machine Learning Professional. • Advanced hands-on expertise in data engineering and solution architecture, with demonstrated ability to design and deliver complex data solutions. • Strong hands-on expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog), AWS, SQL, and Python, including large-scale batch and streaming workloads. • Experience with relational databases such as MySQL, database migration/re-engineering, Fivetran or similar ingestion/ELT technologies, and modern data-sharing patterns. • Experience with Delta Lake, Apache Iceberg, and other open table formats, including schema evolution, optimisation, and interoperability across engines. • Hands-on experience designing scalable data platforms and pipelines using technologies such as Kafka, Amazon EventBridge, or Amazon SQS, along with Terraform and CI/CD practices. **Preferred technical and professional experience** • Experience with Databricks Lakebase or similar managed PostgreSQL/OLTP-on-lakehouse technologies. • Knowledge of SAP BTP, BDC Connect, SAP extraction patterns, or SAP IS-U. • Exposure to GCP ML/GenAI services and cloud-native solution design across AWS and GCP. • Experience with Git-based version control and branching strategies for data workloads. • Experience in the utilities or energy industry, with relevant Databricks and/or AWS certification IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

New York, NY

**Introduction** A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. **Your role and responsibilities**
Work authorization
• Experience in the utilities or energy industry, with relevant Databricks and/or AWS certification IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Open source at www.ibm.com ↗

This posting reached us through a job exchange.

Read the full description ↓

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.