Time since we first saw it
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
Work setup in the employer’s posting: TELECOMMUTEFrom the employer’s posting
Design and optimize scalable Spark data engineering solutions on Azure
Own end-to-end data pipelines from ingestion through storage and analytics
Build and maintain medallion-architecture pipelines for structured and complex datasets
Mentor junior engineers and set coding standards and best practices
Apply CI/CD practices to automate validation and deployment of pipelines
Lead the design, development, and optimization of scalable data engineering solutions on Azure
Own end-to-end data transformation pipelines, including ingestion, transformation, storage, and analytics
Build and maintain data pipelines within a medallion architecture, supporting structured and complex datasets
Mentor and guide junior engineers, setting coding standards and best practices
Apply CI/CD practices to automate validation and deployment of data pipelines
We are looking for a Senior Data Software Engineer to contribute to the design and development of a modern enterprise data platform focused on large-scale financial data processing. The platform is being built to deliver new capabilities rather than maintain legacy systems, with a strong emphasis on data quality, governance, and scalable processing across cloud-native technologies. The role involves working on data ingestion, transformation, modeling, and optimization within a medallion architecture, supporting both structured and complex datasets, including private markets data. Nice to have Hands-on experience with Microsoft Fabric and OneLake Expertise in Cosmos DB (NoSQL API) specifically Familiarity with financial instruments and financial services data Familiarity with AI-assisted development tools such as GitHub Copilot and awareness of industry-standard LLMs Understanding of Data Science fundamentals and collaboration experience with DS teams Requirements 5+ years of experience in data engineering, with a focus on large-scale data processing Proficiency in Microsoft Fabric, Apache Spark, and Python Skills in Pandas, Delta Lake, and Parquet for data processing, storage, and optimization Knowledge of Cosmos DB for bitemporal data storage and retrieval Familiarity with AWS Glue for supporting ETL workflows Expertise in Spark Streaming for near real-time processing with watermarking support Competency in CI/CD tools for building automated validation pipelines Background in mentoring engineers and establishing coding standards and best practices English proficiency at B2 level or higher Responsibilities Lead the design, development, and optimization of scalable data engineering solutions on Azure, using Spark-based processing (PySpark, SparkSQL, Scala, or equivalent) Own end-to-end data transformation pipelines, including ingestion, transformation, storage, and analytics Work with Azure-native data services such as Data Factory, Databricks, and Synapse Support high-performance data access patterns using Cosmos DB (NoSQL API) where applicable Collaborate with data scientists, AI engineers, and product stakeholders to enable data-driven analytics and insights Mentor and guide junior engineers, setting coding standards and best practices Ensure data quality, security, governance, and performance across platforms Contribute to technical decision-making and solution architecture discussions Build and maintain data pipelines within a medallion architecture, supporting structured and complex datasets Apply CI/CD practices to automate validation and deployment of data pipelines
Actively hiringFirst seen by us 3 days ago, still listed, and not a repost of an earlier posting.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 3
Early. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
892 open jobs
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Poland
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting