Time since we first saw it
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
We are seeking a Senior Data Engineer to support the ingestion, processing, and synchronization of data across our analytics platform. This role focuses on using Python Notebooks to ingest data via APIs into Microsoft Fabric's Data Lake and Data Warehouse, with some data being synced to a Synapse Analytics database for broader reporting needs. The ideal candidate will have hands-on experience working with API-based data ingestion and modern data architectures, including implementing Medallion layer architecture (Bronze, Silver, Gold) for optimal data organization and quality management, with bonus points for exposure to marketing APIs like Google Ads, Google Business Profile, and Google Analytics 4. This is a remote position. We welcome applicants globally, but this role has a preference for LATAM candidates to ensure smoother collaboration with our existing team Key Responsibilities Build and maintain Python Notebooks to ingest data from third-party APIs Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement Store and manage data within Microsoft Fabric's Data Lake and Warehouse using delta parquet file formats Set up data pipelines and sync key datasets to Azure Synapse Analytics Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers Collaborate with developers, analysts, and stakeholders to ensure data availability and accuracy Monitor, test, and optimize data flows for reliability and performance Document processes and contribute to best practices for data ingestion and transformation Tech Stack You'll Use Ingestion & Processing: Python (Notebooks) PySpark Storage & Warehousing: Microsoft Fabric Data Lake & Data Warehouse Delta Parquet files Sync & Reporting: Azure Synapse Analytics Cloud & Tooling: Azure Data Factory, Azure DevOps Requirements Strong experience with Python for data ingestion and transformation Proficiency with PySpark for large-scale data processing; Proficiency in working with RESTful APIs and handling large datasets; Experience with Microsoft Fabric or similar modern data platforms; Understanding of Medallion architecture (Bronze, Silver, Gold layers) and data lakehouse concepts; Experience working with Delta Lake and parquet file formats; Understanding of data warehousing concepts and performance tuning; Familiarity with cloud-based workflows, especially within the Azure ecosystem. Nice to Have Experience with marketing APIs such as Google Ads or Google Analytics 4; Familiarity with Azure Synapse and Data Factory pipeline design; Understanding of data modeling for analytics and reporting use cases; Experience with AI coding tools; Experience with Fivetran, Aribyte, and Riverly.Read the full posting
Employment type in the employer’s posting: Full timeFrom the employer’s posting
Build and maintain Python notebooks that ingest data from third-party APIs
Design Medallion (Bronze, Silver, Gold) layer architecture for data refinement
Set up data pipelines and sync key datasets to Azure Synapse Analytics
Develop PySpark transformations across Bronze, Silver, and Gold layers
Monitor, test, and optimize data flows for reliability and performance
Build and maintain Python Notebooks to ingest data from third-party APIs
Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement
Set up data pipelines and sync key datasets to Azure Synapse Analytics
Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers
Monitor, test, and optimize data flows for reliability and performance
We are seeking a Senior Data Engineer to support the ingestion, processing, and synchronization of data across our analytics platform. This role focuses on using Python Notebooks to ingest data via APIs into Microsoft Fabric's Data Lake and Data Warehouse, with some data being synced to a Synapse Analytics database for broader reporting needs. The ideal candidate will have hands-on experience working with API-based data ingestion and modern data architectures, including implementing Medallion layer architecture (Bronze, Silver, Gold) for optimal data organization and quality management, with bonus points for exposure to marketing APIs like Google Ads, Google Business Profile, and Google Analytics 4. This is a remote position. We welcome applicants globally, but this role has a preference for LATAM candidates to ensure smoother collaboration with our existing team Key Responsibilities Build and maintain Python Notebooks to ingest data from third-party APIs Design and implement Medallion layer architecture (Bronze, Silver, Gold) for structured data organization and progressive data refinement Store and manage data within Microsoft Fabric's Data Lake and Warehouse using delta parquet file formats Set up data pipelines and sync key datasets to Azure Synapse Analytics Develop PySpark-based data transformation processes across Bronze, Silver, and Gold layers Collaborate with developers, analysts, and stakeholders to ensure data availability and accuracy Monitor, test, and optimize data flows for reliability and performance Document processes and contribute to best practices for data ingestion and transformation Tech Stack You'll Use Ingestion & Processing: Python (Notebooks) PySpark Storage & Warehousing: Microsoft Fabric Data Lake & Data Warehouse Delta Parquet files Sync & Reporting: Azure Synapse Analytics Cloud & Tooling: Azure Data Factory, Azure DevOps Requirements Strong experience with Python for data ingestion and transformation Proficiency with PySpark for large-scale data processing; Proficiency in working with RESTful APIs and handling large datasets; Experience with Microsoft Fabric or similar modern data platforms; Understanding of Medallion architecture (Bronze, Silver, Gold layers) and data lakehouse concepts; Experience working with Delta Lake and parquet file formats; Understanding of data warehousing concepts and performance tuning; Familiarity with cloud-based workflows, especially within the Azure ecosystem. Nice to Have Experience with marketing APIs such as Google Ads or Google Analytics 4; Familiarity with Azure Synapse and Data Factory pipeline design; Understanding of data modeling for analytics and reporting use cases; Experience with AI coding tools; Experience with Fivetran, Aribyte, and Riverly.
Open 5 monthsWe first saw this posting 172 days ago and it is still up. Roles open this long are often slow to fill or kept open to collect applications.
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
Day 172
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
1 open job
Check the employer’s posting for the current role and application details.
Already applied? Track this application
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
Location not supplied.
This passage needs a closer read in the full description.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting