Design and develop Snowflake data warehouse objects, pipelines and migrations
Write SQL, Snowflake stored procedures and Python scripts for ETL/ELT workloads
Build and maintain data pipelines for reporting, analytics and applications
Develop unit tests for SQL scripts, procedures and data pipelines
Write technical design documents and pipeline deployment and monitoring procedures
From the employer’s posting
Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
Develops and/or reviews unit testing protocols for SQL scripts, procedures, and data pipelines using automation frameworks.
Writes technical design documentation based on business requirements and data architecture principles.
Education & alternatives
- Strong verbal and written communication skills to engage both technical and non-technical audiences at various organisational levels.
- Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience).
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
AWS
Azure
S3
Snowflake
Where the posting names them
- Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
- Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
- Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
- Experience configuring external stages to integrate with cloud storage (AWS S3, Azure Blob, etc.).
- Experience writing Python/Shell scripts for data processing.
- Proficiency in using Git and working within Agile/Scrum SDLC environments.
At Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk and make informed decisions globally. By leveraging our core strengths in technology, we continue to identify new ways to serve our customers and transform global markets.
ICE is seeking a Senior Data Engineer who will be responsible for design and optimise SQL queries, develop stored procedures, and participate in the migration and modernisation of legacy applications to support ICE Derivatives and ICE Mortgage. The candidate should have a strong background in SQL and scripting.
Responsibilities
- Writes technical design documentation based on business requirements and data architecture principles.
- Develops and/or reviews unit testing protocols for SQL scripts, procedures, and data pipelines using automation frameworks.
- Completes documentation and procedures for pipeline deployment, operational handover, and monitoring.
- Proficiency in database performance tuning and performance optimisation — clustering, warehouse sizing, caching, etc.
- Experience configuring external stages to integrate with cloud storage (AWS S3, Azure Blob, etc.).
- Experience writing Python/Shell scripts for data processing.
Responsibilities
- Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
- Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
- Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
- Creates and maintains Snowflake objects like tables, views, streams, tasks, file formats, and external stages.
- Participates in project meetings with data engineers, analysts, business users, and product owners to understand and implement technical requirements.
- Optimise cloud data platforms for AI scalability, including data lakehouse architectures, semantic layers, and high-performance data retrieval patterns.
- Stays current with Snowflake features, best practices, and industry trends in cloud data platforms.
- Performs additional related duties as assigned.
- 5+ years of professional experience in data engineering or database development.
- Expert knowledge of Snowflake (Tidal is an added advantage).
- Strong Hands-on experience:
At Intercontinental Exchange (ICE), we engineer technology, exchanges and clearing houses that connect companies around the world to global capital and derivative markets. With a leading-edge approach to developing technology platforms, we have built market infrastructure in all major trading centers, offering customers the ability to manage risk and make informed decisions globally. By leveraging our core strengths in technology, we continue to identify new ways to serve our customers and transform global markets.
ICE is seeking a Senior Data Engineer who will be responsible for design and optimise SQL queries, develop stored procedures, and participate in the migration and modernisation of legacy applications to support ICE Derivatives and ICE Mortgage. The candidate should have a strong background in SQL and scripting.
Responsibilities
Provides Snowflake-based data warehouse design and development for projects involving new data integration, migration, and enhancement of existing pipelines.
Designs and develops data transformation logic using SQL, Snowflake stored procedures, and Python-based scripts for ETL/ELT workloads.
Builds and maintains robust data pipelines to support reporting, analytics, and application data needs.
Creates and maintains Snowflake objects like tables, views, streams, tasks, file formats, and external stages.
Participates in project meetings with data engineers, analysts, business users, and product owners to understand and implement technical requirements.
Writes technical design documentation based on business requirements and data architecture principles.
Develops and/or reviews unit testing protocols for SQL scripts, procedures, and data pipelines using automation frameworks.
Completes documentation and procedures for pipeline deployment, operational handover, and monitoring.
May mentor or guide junior developers and data engineers.
Enable real-time and batch data processing architectures that support AI-driven analytics, recommendations, forecasting, and intelligent automation.
Optimise cloud data platforms for AI scalability, including data lakehouse architectures, semantic layers, and high-performance data retrieval patterns.
Stays current with Snowflake features, best practices, and industry trends in cloud data platforms.
Performs additional related duties as assigned.
Knowledge and Experience
5+ years of professional experience in data engineering or database development.
Expert knowledge of Snowflake (Tidal is an added advantage).
Strong Hands-on experience:
Writing complex SQL queries and stored procedures
Database stored procedures, functions, views, and schema design
Using Streams, Tasks, Time Travel, and Cloning
Proficiency in database performance tuning and performance optimisation — clustering, warehouse sizing, caching, etc.
Experience configuring external stages to integrate with cloud storage (AWS S3, Azure Blob, etc.).
Experience writing Python/Shell scripts for data processing.
Proficiency in using Git and working within Agile/Scrum SDLC environments.
Familiarity working in a Software Development Life Cycle (SDLC) leveraging Agile principles.
Excellent analytical, decision-making, and problem-solving skills.
Ability to multitask in a fast-paced environment with a focus on timeliness, documentation, and communication with peers and business users.
Strong verbal and written communication skills to engage both technical and non-technical audiences at various organisational levels.
Bachelor’s degree in computer science, Engineering, or related field (or equivalent experience).
About Intercontinental Exchange Holdings
People
About 12,844 in 2025, down 1% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ICE.
H-1B visas
111 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.