Strong SQL, including complex queries, CTEs, and window functions
Python for data engineering and automation
Hands-on dbt experience (Core or Cloud)
Experience with Apache Airflow or similar orchestration tools
Preferred experience
Experience with data replication tools such as Qlik Replicate, Fivetran, AWS DMS, or similar CDC solutions
Experience setting up and managing infrastructure for dbt Core, including deployment automation, testing frameworks, and orchestration integration
Knowledge of real-time data streaming and event-driven architectures
Knowledge of containerization (Docker) and infrastructure as code (Terraform, CloudFormation)
Qualification wording
Strong proficiency in SQL with experience writing complex queries, CTEs, and window functions
Proficiency in Python for data engineering tasks, scripting, and automation
Hands-on experience with dbt (Core or Cloud) for data transformation and modeling
Experience orchestrating workflows with Apache Airflow or similar tools
Experience with data replication tools such as Qlik Replicate, Fivetran, AWS DMS, or similar CDC solutions
Experience setting up and managing infrastructure for dbt Core, including deployment automation, testing frameworks, and orchestration integration
Knowledge of real-time data streaming and event-driven architectures
Knowledge of containerization (Docker) and infrastructure as code (Terraform, CloudFormation)
Education & alternatives
Education
- Required knowledge and skills would typically be acquired through a Bachelors degree in computer science, business, or related field
Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn’t the right fit but you’re interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch’s Talent Acquisition team.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
Python
SQL
AWS
Azure
BigQuery
dbt
Docker
Fivetran
GCP
Qlik
Redshift
Snowflake
Terraform
Airflow
Where the posting names them
- Strong proficiency in SQL with experience writing complex queries, CTEs, and window functions
- Proficiency in Python for data engineering tasks, scripting, and automation
- Hands-on experience with dbt (Core or Cloud) for data transformation and modeling
- Develop and optimize data models in Snowflake, leveraging cloud data warehouse capabilities for performance and cost efficiency
- Write complex SQL for data transformation, quality validation, and business logic implementation
- Collaborate closely with the infrastructure team to ensure the data platform remains modern, well-monitored, and fully optimized, with industry best practices consistently applied
- 3+ years of experience in data engineering or related role
- Strong proficiency in SQL with experience writing complex queries, CTEs, and window functions
- Proficiency in Python for data engineering tasks, scripting, and automation
Desired Skills:
- Experience with data replication tools such as Qlik Replicate, Fivetran, AWS DMS, or similar CDC solutions
- Experience setting up and managing infrastructure for dbt Core, including deployment automation, testing frameworks, and orchestration integration
- Knowledge of containerization (Docker) and infrastructure as code (Terraform, CloudFormation)
- Experience with cloud platforms (AWS, Azure, GCP)
- Knowledge of data governance and security best practices
- Experience orchestrating workflows with Apache Airflow or similar tools
- Working knowledge of Snowflake or similar cloud data warehouses (Redshift, BigQuery)
- Understanding of infrastructure requirements for data engineering, including deployment strategies, environment configuration, and resource management
- Design and develop data pipelines using Apache Airflow to orchestrate complex workflows and ensure reliable data delivery
- Build and maintain transformation logic using dbt Core, supporting the infrastructure needed, implementing best practices for modular, tested, and documented analytics code
- Develop and optimize data models in Snowflake, leveraging cloud data warehouse capabilities for performance and cost efficiency
- Proficiency in Python for data engineering tasks, scripting, and automation
- Hands-on experience with dbt (Core or Cloud) for data transformation and modeling
- Experience orchestrating workflows with Apache Airflow or similar tools
- Experience with data replication tools such as Qlik Replicate, Fivetran, AWS DMS, or similar CDC solutions
- Experience setting up and managing infrastructure for dbt Core, including deployment automation, testing frameworks, and orchestration integration
- Knowledge of real-time data streaming and event-driven architectures
- Knowledge of real-time data streaming and event-driven architectures
- Knowledge of containerization (Docker) and infrastructure as code (Terraform, CloudFormation)
- Experience with cloud platforms (AWS, Azure, GCP)
- Build and maintain transformation logic using dbt Core, supporting the infrastructure needed, implementing best practices for modular, tested, and documented analytics code
- Develop and optimize data models in Snowflake, leveraging cloud data warehouse capabilities for performance and cost efficiency
- Write complex SQL for data transformation, quality validation, and business logic implementation
- Document data pipelines, models, and processes for knowledge sharing
- Optimize query performance and manage Snowflake resource utilization
- Participate in code reviews and contribute to data engineering best practices
Tasks/Responsibilities
- Design and develop data pipelines using Apache Airflow to orchestrate complex workflows and ensure reliable data delivery
- Build and maintain transformation logic using dbt Core, supporting the infrastructure needed, implementing best practices for modular, tested, and documented analytics code
- Hands-on experience with dbt (Core or Cloud) for data transformation and modeling
- Experience orchestrating workflows with Apache Airflow or similar tools
- Working knowledge of Snowflake or similar cloud data warehouses (Redshift, BigQuery)
Complete your application on archgroup.wd1.myworkdayjobs.com. The employer’s form will show what is required.
Applying through Workday
You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
“Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
Your application status lives in that employer’s Candidate Home, under the same sign-in.
With a company culture rooted in collaboration, expertise and innovation, we aim to promote progress and inspire our clients, employees, investors and communities to achieve their greatest potential. Our work is the catalyst that helps others achieve their goals. In short, We Enable Possibility℠.
This position develops, implements, and maintains software solutions that enable business operations to realise company goals & objectives. The incumbent performs analysis, design, coding, debugging, testing, and support of software application systems. He/she may be assigned to develop new applications, enhance existing applications and/or provide production support. The incumbent works independently on projects of moderate scope or complexity and receives detailed instructions on new and/or more complex assignments.
Tasks/Responsibilities
Design and develop data pipelines using Apache Airflow to orchestrate complex workflows and ensure reliable data delivery
Build and maintain transformation logic using dbt Core, supporting the infrastructure needed, implementing best practices for modular, tested, and documented analytics code
Develop and optimize data models in Snowflake, leveraging cloud data warehouse capabilities for performance and cost efficiency
Write complex SQL for data transformation, quality validation, and business logic implementation
Collaborate closely with the infrastructure team to ensure the data platform remains modern, well-monitored, and fully optimized, with industry best practices consistently applied
Collaborate with analytics and business teams to understand requirements and translate them into scalable data solutions
Implement data quality checks, monitoring, and alerting to ensure data reliability
Document data pipelines, models, and processes for knowledge sharing
Optimize query performance and manage Snowflake resource utilization
Participate in code reviews and contribute to data engineering best practices
Requirements Skills/Experience
3+ years of experience in data engineering or related role
Strong proficiency in SQL with experience writing complex queries, CTEs, and window functions
Proficiency in Python for data engineering tasks, scripting, and automation
Hands-on experience with dbt (Core or Cloud) for data transformation and modeling
Experience orchestrating workflows with Apache Airflow or similar tools
Working knowledge of Snowflake or similar cloud data warehouses (Redshift, BigQuery)
Understanding of infrastructure requirements for data engineering, including deployment strategies, environment configuration, and resource management
Understanding of dimensional modeling and data warehouse design patterns
Experience with version control (Git) and CI/CD practices
Strong problem-solving skills and attention to data quality
Desired Skills:
Experience with data replication tools such as Qlik Replicate, Fivetran, AWS DMS, or similar CDC solutions
Experience setting up and managing infrastructure for dbt Core, including deployment automation, testing frameworks, and orchestration integration
Knowledge of real-time data streaming and event-driven architectures
Knowledge of containerization (Docker) and infrastructure as code (Terraform, CloudFormation)
Experience with cloud platforms (AWS, Azure, GCP)
Knowledge of data governance and security best practices
Familiarity with DataOps practices and testing frameworks
Understanding of software engineering principles and agile methodologies
Education
Required knowledge and skills would typically be acquired through a Bachelors degree in computer science, business, or related field
Do you like solving complex business problems, working with talented colleagues and have an innovative mindset? Arch may be a great fit for you. If this job isn’t the right fit but you’re interested in working for Arch, create a job alert! Simply create an account and opt in to receive emails when we have job openings that meet your criteria. Join our talent community to share your preferences directly with Arch’s Talent Acquisition team.
10400 Arch Global Services (Philippines) Inc.
About Arch Capital Group
People
About 8,000 in 2025, up 11% from the year before.Annual report (SEC Form 10-K)
Company
Listed as ACGL.
H-1B visas
18 approved for new hires in fiscal 2025.US Citizenship and Immigration Services
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.