Manage and monitor distributed systems, storage and data processing platforms
Build automation and CI/CD to deploy hardware and software quickly
Support and troubleshoot queries from traders, developers and engineers
Propose, evaluate and implement new technology solutions
From the employer’s posting
Manage and monitor distributed systems, storage infrastructure, and data processing platforms
Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions
Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries
propose, evaluate, and implement innovative solutions
About IMC
A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors.
Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
AWS
Azure
Docker
GCP
HDFS
Kafka
Kubernetes
Prefect
Airflow
Where the posting names them
- Familiarity with workflow orchestration tools like Airflow and Prefect.
- Exposure to cloud platforms such as AWS, GCP, or Azure.
About Us
- Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
- Working knowledge of Docker, Kubernetes, and Helm.
- Experience with data access technologies such as Dremio and Presto.
Your Core Responsibilities:
- Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
- Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
- Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
- Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
- Working knowledge of Docker, Kubernetes, and Helm.
- Experience with data access technologies such as Dremio and Presto.
- Familiarity with workflow orchestration tools like Airflow and Prefect.
- Exposure to cloud platforms such as AWS, GCP, or Azure.
Complete your application on job-boards.eu.greenhouse.io. The employer’s form will show what is required.
Applying through Greenhouse
No account needed: the form is one page, with an “Autofill my application” option that reads your resume.
Greenhouse doesn’t read resumes over 2.5 MB, or details placed in a header, footer, text box, table or second column. The file still attaches, but a recruiter has to type you in by hand.
Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.
You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.
Your Core Responsibilities:
Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.
Your Skills and Experience:
2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.
Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
Working knowledge of Docker, Kubernetes, and Helm.
Experience with data access technologies such as Dremio and Presto.
Familiarity with workflow orchestration tools like Airflow and Prefect.
Exposure to cloud platforms such as AWS, GCP, or Azure.
About Us
IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. A stabilizing force in markets since 1989, we provide liquidity across trading venues, delivering the best outcome in value and risk management to investors. Using our own technology and capital, we build proprietary systems and algorithms that operate across global markets. Our researchers, traders, and engineers work as a collective, combining rapid experimentation, advanced infrastructure, and real-time feedback to turn insight into execution and execution into advantage.
Demand for Data Engineer roles
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
August 17Last week
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
About the role
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
US government figures for database architects
Median yearly pay, May 2025
$139,500
Expected change, 2025 to 2035
9.4% more jobsagainst 3.5% for all jobs
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.