Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
Work setup in the employer’s posting: RemoteFrom the employer’s posting
Employment type in the employer’s posting: Full-timeFrom the employer’s posting
Design and maintain batch and real-time data pipelines using Maxwell, Kafka, Spark and dbt
Develop data models following Medallion Architecture (Bronze, Silver, Gold)
Build and maintain cloud data platforms on S3, Spark, Trino and BigQuery
Create and maintain data warehouses and data marts for reporting
Own end-to-end lifecycle of critical pipelines, including monitoring and incident resolution
Design, build, and maintain scalable batch and real-time data pipelines using Maxwell, Kafka, Spark, and dbt
Develop and optimize data models following Medallion Architecture (Bronze, Silver, Gold)
Build and maintain cloud-native data platforms using S3, Spark, Trino, and BigQuery
Create, optimize, and maintain data warehouses and data marts that enable fast, reliable reporting and self-service analytics
Own the end-to-end lifecycle of critical data pipelines, ensuring high availability, monitoring, SLA adherence, and proactive incident resolution
4+ years of hands-on experience designing and building scalable data platforms, data lakes, and data warehouses.
Strong proficiency in Spark (Scala, python) and SQL, with experience building production-grade data pipelines and distributed data processing applications.
Hands-on experience with Apache Spark and a solid understanding of distributed data processing, performance tuning, and optimization.
Experience building batch and streaming data pipelines using technologies such as Kafka, CDC/Maxwell, or similar event-driven architectures.
Strong understanding of modern data lake architectures, including Medallion Architecture, data modeling, partitioning, and storage optimization.
Experience working with cloud-native data platforms and technologies such as Amazon S3, BigQuery, Trino, or similar analytics engines.
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,766 similar postings that came down. Coming down is not always a hire.
3 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordAdd your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.
- 4+ years of hands-on experience designing and building scalable data platforms, data lakes, and data warehouses. - Strong proficiency in Spark (Scala, python) and SQL, with experience building production-grade data pipelines and distributed data processing applications. - Hands-on experience with Apache Spark and a solid understanding of distributed data processing, performance tuning, and optimization.
- Strong knowledge of data quality, observability, lineage, and engineering best practices to build reliable and maintainable data products. - Experience optimizing large-scale data pipelines, SQL queries, and distributed processing jobs for performance, scalability, and cost efficiency. - Familiarity with CI/CD, Git-based development workflows, infrastructure automation, and modern software engineering best practices.
We're looking for a passionate Data Engineer II to help build and scale the data platform that powers analytics, product insights, and data-driven decision making across the organization. You'll work on modern data technologies including Kafka, Maxwell, Spark, S3, Trino, BigQuery, dbt, and Metabase to build reliable, scalable, and high-performance data systems. From real-time data ingestion and distributed data processing to dimensional modeling and data platform development, you'll play a key role in shaping the foundation of our data ecosystem. As part of the Data Engineering team, you'll design and build robust data pipelines, implement modern data lake architectures, develop reusable data models, and create trusted datasets that empower Product, Analytics, Data Science, and Business teams. You'll also contribute to improving our engineering standards by focusing on performance, reliability, observability, automation, and developer experience.
- Develop and optimize data models following Medallion Architecture (Bronze, Silver, Gold) to create reliable, reusable, and high-quality datasets. - Build and maintain cloud-native data platforms using S3, Spark, Trino, and BigQuery, ensuring scalability, reliability, and cost efficiency. - Design robust data ingestion frameworks leveraging CDC (Maxwell), Kafka, and event-driven architectures to support near real-time data processing.
- Strong understanding of modern data lake architectures, including Medallion Architecture, data modeling, partitioning, and storage optimization. - Experience working with cloud-native data platforms and technologies such as Amazon S3, BigQuery, Trino, or similar analytics engines. - Solid experience designing dimensional models, star schemas, and building reliable data marts that support analytics and business intelligence.
What You Will Do ❓ - Design, build, and maintain scalable batch and real-time data pipelines using Maxwell, Kafka, Spark, and dbt to power analytics and business-critical applications. - Develop and optimize data models following Medallion Architecture (Bronze, Silver, Gold) to create reliable, reusable, and high-quality datasets.
- Partner closely with Product Managers, Data Analysts, Backend Engineers, and Business stakeholders to translate business requirements into scalable data solutions. - Develop reusable dbt models, testing frameworks, and documentation to improve data quality, governance, and developer productivity. - Optimize Spark jobs, Trino queries, and storage layouts for performance, reliability, and cost efficiency.
- Solid experience designing dimensional models, star schemas, and building reliable data marts that support analytics and business intelligence. - Hands-on experience with dbt, including developing reusable models, implementing automated testing, and maintaining documentation. - Strong knowledge of data quality, observability, lineage, and engineering best practices to build reliable and maintainable data products.
- Build and maintain cloud-native data platforms using S3, Spark, Trino, and BigQuery, ensuring scalability, reliability, and cost efficiency. - Design robust data ingestion frameworks leveraging CDC (Maxwell), Kafka, and event-driven architectures to support near real-time data processing. - Create, optimize, and maintain data warehouses and data marts that enable fast, reliable reporting and self-service analytics.
- Hands-on experience with Apache Spark and a solid understanding of distributed data processing, performance tuning, and optimization. - Experience building batch and streaming data pipelines using technologies such as Kafka, CDC/Maxwell, or similar event-driven architectures. - Strong understanding of modern data lake architectures, including Medallion Architecture, data modeling, partitioning, and storage optimization.
- Ensure data quality through validation, monitoring, lineage, and observability while implementing best practices for security and governance. - Enable analytics teams by delivering trusted datasets, semantic models, and dashboards that power decision-making through Metabase. Requirements
- Develop reusable dbt models, testing frameworks, and documentation to improve data quality, governance, and developer productivity. - Optimize Spark jobs, Trino queries, and storage layouts for performance, reliability, and cost efficiency. - Own the end-to-end lifecycle of critical data pipelines, ensuring high availability, monitoring, SLA adherence, and proactive incident resolution.
- Strong proficiency in Spark (Scala, python) and SQL, with experience building production-grade data pipelines and distributed data processing applications. - Hands-on experience with Apache Spark and a solid understanding of distributed data processing, performance tuning, and optimization. - Experience building batch and streaming data pipelines using technologies such as Kafka, CDC/Maxwell, or similar event-driven architectures.
Complete your application on apply.workable.com. The employer’s form will show what is required.
Already applied? Track this application
Who Are We
Welcome to the world of Mrsool! 🌍✨ Where on-demand delivery meets unparalleled user needs to deliver anything you desire. As one of the largest delivery platforms in the Middle East and North Africa (MENA) region, Mrsool has captivated users with its unique and seamless experience, earning it the highest ratings among all major delivery platforms on both Apple's App Store and Google's Play Store. 🌟📲
What sets Mrsool apart is its commitment to providing an unmatched "order anything from anywhere" experience. 🌐📦 This extraordinary feat is made possible by our extensive fleet of dedicated on-demand couriers. With their unwavering dedication, they ensure that your desired items reach your doorstep, no matter where you are. 🚗🚲
Whether it's a late-night craving, a forgotten item, or a special gift for a loved one, Mrsool is here to deliver, quite literally. 😋🎁 We take pride in the convenience we offer, empowering you to get what you need when you need it, all at the tap of a button. 💪🏼💫
The Job in a Nutshell 💡
We're looking for a passionate Data Engineer II to help build and scale the data platform that powers analytics, product insights, and data-driven decision making across the organization.
You'll work on modern data technologies including Kafka, Maxwell, Spark, S3, Trino, BigQuery, dbt, and Metabase to build reliable, scalable, and high-performance data systems. From real-time data ingestion and distributed data processing to dimensional modeling and data platform development, you'll play a key role in shaping the foundation of our data ecosystem.
As part of the Data Engineering team, you'll design and build robust data pipelines, implement modern data lake architectures, develop reusable data models, and create trusted datasets that empower Product, Analytics, Data Science, and Business teams. You'll also contribute to improving our engineering standards by focusing on performance, reliability, observability, automation, and developer experience.
This role is ideal for someone who enjoys solving complex data engineering challenges, building scalable platforms, and continuously improving how data is collected, transformed, and consumed across the organization.
If you're excited about building modern data platforms, working with large-scale distributed systems, and having a meaningful impact on the company's data strategy, we'd love to hear from you.
Requirements
Benefits
Inclusive and Diverse Environment: We foster an inclusive and diverse workplace that values innovation and offers remote environments.
Competitive Compensation: Our compensation packages are highly competitive and include potential share options for certain roles.
Personal Growth and Development: We are committed to your personal and professional growth, providing regular training and an annual learning stipend to help you advance your career in a dynamic environment.
Autonomy and Mentorship: You'll enjoy a high degree of autonomy in your role, supported by mentorship and ambitious goals that pave the way for both your success and the company's growth.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
India
What We Offer You❗ Inclusive and Diverse Environment: We foster an inclusive and diverse workplace that values innovation and offers remote environments. Competitive Compensation: Our compensation packages are highly competitive and include potential share options for certain roles.
No clear work-authorization passage found. Eligibility is unconfirmed.