Pay
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
FL Miami - Aventura, FL 33180
Live, first seen by us 77 days agoEmployment type in the employer’s posting: Full TimeFrom the employer’s posting
Design and implement scalable data pipelines for ingestion, transformation and storage
Architect and optimize data lakes and data warehouses for analytics and reporting
Build ETL processes that integrate structured and unstructured data from diverse sources
Lead big data work with Hadoop and Spark for processing large datasets
Establish and maintain CI/CD pipelines for deployment and reliability
Design and implement scalable data pipelines for data ingestion, transformation, and storage.
Architect and optimize data lakes and data warehouses to support analytics and reporting needs.
Develop robust ETL processes to integrate structured and unstructured data from diverse sources.
Lead the implementation of big data frameworks such as Hadoop and Spark for processing large datasets.
Establish and maintain CI/CD pipelines to ensure efficient deployment and system reliability.
Required: · Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. · 5+ years of experience as a Data Engineer with expertise in building large-scale data solutions.
· Utilize Python and SQL to develop efficient, production-ready code for data pipelines and integrations. · Implement scripting automation using Bash and PowerShell to streamline workflows. · Leverage version control (Git) and follow best practices in code optimization, unit testing, and debugging.
· 5+ years of experience as a Data Engineer with expertise in building large-scale data solutions. · Proficiency in Python, SQL, and scripting languages (Bash, PowerShell). · Deep understanding of big data tools (Hadoop, Spark) and ETL processes.
Software Development and Automation · Utilize Python and SQL to develop efficient, production-ready code for data pipelines and integrations. · Implement scripting automation using Bash and PowerShell to streamline workflows.
· Strong experience in software architecture, design patterns, and code optimization. · Expertise in Python-based pipelines and ETL frameworks. · Experience with Azure Data Services and Databricks.
Database and Data Warehousing · Design, implement, and manage relational (SQL) and non-relational (NoSQL) database systems. · Lead database architecture efforts, including schema design, query optimization, and performance tuning.
· Hands-on experience with cloud platforms (AWS S3, Azure Data Lake, Google BigQuery, Snowflake). · Strong knowledge of database systems (SQL, NoSQL), database design, and query optimization. · Experience designing and managing data warehouses for performance and scalability.
· Lead the implementation of big data frameworks such as Hadoop and Spark for processing large datasets. · Develop and optimize solutions on cloud platforms, including AWS S3, Azure Data Lake, Google BigQuery, and Snowflake. · Manage data lakes to facilitate efficient data access and processing for downstream applications.
· Deep understanding of big data tools (Hadoop, Spark) and ETL processes. · Hands-on experience with cloud platforms (AWS S3, Azure Data Lake, Google BigQuery, Snowflake). · Strong knowledge of database systems (SQL, NoSQL), database design, and query optimization.
· Expertise in Python-based pipelines and ETL frameworks. · Experience with Azure Data Services and Databricks. · Excellent problem-solving, analytical, and communication skills.
Cloud and Big Data Solutions · Lead the implementation of big data frameworks such as Hadoop and Spark for processing large datasets. · Develop and optimize solutions on cloud platforms, including AWS S3, Azure Data Lake, Google BigQuery, and Snowflake.
· Proficiency in Python, SQL, and scripting languages (Bash, PowerShell). · Deep understanding of big data tools (Hadoop, Spark) and ETL processes. · Hands-on experience with cloud platforms (AWS S3, Azure Data Lake, Google BigQuery, Snowflake).
These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.
$127K–$189K is typical
The middle half of what similar US postings state. This one doesn’t list pay.
From 2,448 postings in the last year. Stated ranges, not salaries paid.
Day 77
Up longer than most. Similar jobs usually come down between day 6 and day 56.
From 14,770 similar postings that came down. Coming down is not always a hire.
1 open job
Open jobs by the week we first saw them, last 12 weeks.
Hiring recordCheck the employer’s posting for the current role and application details.
Already applied? Track this application
We are seeking an experienced Data Engineer to lead the design, development, and optimization of end-to-end data pipelines and cloud-based solutions. You will be responsible for architecting scalable data and analytic systems, ensuring data integrity, and implementing software engineering best practices and patterns. The ideal candidate has a strong background in ETL, big data technologies, and cloud services, with a proven ability to drive complex projects from concept to production.
Primary Responsibilities/Essential Functions
This job description in no way states or implies that these are the only duties to be performed by the teammate occupying this position. The selected candidate may perform other related duties assigned to meet the ongoing needs of the business.
Key Responsibilities
Data Architecture and Engineering
· Design and implement scalable data pipelines for data ingestion, transformation, and storage.
· Architect and optimize data lakes and data warehouses to support analytics and reporting needs.
· Develop robust ETL processes to integrate structured and unstructured data from diverse sources.
· Ensure high data quality through cleaning, validation, and transformation techniques.
Cloud and Big Data Solutions
· Lead the implementation of big data frameworks such as Hadoop and Spark for processing large datasets.
· Develop and optimize solutions on cloud platforms, including AWS S3, Azure Data Lake, Google BigQuery, and Snowflake.
· Manage data lakes to facilitate efficient data access and processing for downstream applications.
Database and Data Warehousing
· Design, implement, and manage relational (SQL) and non-relational (NoSQL) database systems.
· Lead database architecture efforts, including schema design, query optimization, and performance tuning.
· Oversee the design and management of data warehouses, ensuring reliability, scalability, and security.
Software Development and Automation
· Utilize Python and SQL to develop efficient, production-ready code for data pipelines and integrations.
· Implement scripting automation using Bash and PowerShell to streamline workflows.
· Leverage version control (Git) and follow best practices in code optimization, unit testing, and debugging.
Collaboration and Leadership
· Act as a technical leader, providing guidance on best practices.
· Collaborate with cross-functional teams (Data Scientists, Software Engineers, Analysts) to meet business objectives.
· Drive innovation by evaluating and integrating emerging tools, technologies, and frameworks.
· Establish and maintain CI/CD pipelines to ensure efficient deployment and system reliability.
Required:
· Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
· 5+ years of experience as a Data Engineer with expertise in building large-scale data solutions.
· Proficiency in Python, SQL, and scripting languages (Bash, PowerShell).
· Deep understanding of big data tools (Hadoop, Spark) and ETL processes.
· Hands-on experience with cloud platforms (AWS S3, Azure Data Lake, Google BigQuery, Snowflake).
· Strong knowledge of database systems (SQL, NoSQL), database design, and query optimization.
· Experience designing and managing data warehouses for performance and scalability.
· Proficiency in software engineering practices: version control (Git), CI/CD pipelines, and unit testing.
Preferred
· Strong experience in software architecture, design patterns, and code optimization.
· Expertise in Python-based pipelines and ETL frameworks.
· Experience with Azure Data Services and Databricks.
· Excellent problem-solving, analytical, and communication skills.
· Experience working in agile environments and collaborating with diverse teams.
New Data Engineer postings at the employers we follow are up 13% over the last 6 weeks compared with the 6 before.
Each bar is one week of new postings. The darkest bars are the last 6 weeks.
Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.
We file this job under Data Engineer, by the work the posting describes.
Data engineers build and run the pipelines that copy data out of apps and outside services into a warehouse or lake, and fix them when a source changes or a load fails.
Expect SQL, Python, a cloud platform, a scheduler such as Airflow, and often tools for large data such as Spark or Kafka.
An analytics engineer works one step later, turning the raw data a data engineer lands into clean tables people can query.
The government has no code for data engineers, so these figures are for the closest group, database architects, which includes data integration and data warehousing specialists.
Source: US Bureau of Labor Statistics, Occupational Employment and Wage Statistics (May 2025) and Employment Projections (2025 to 2035). Occupation code 15-1243.
Selected passages from the saved posting. Check the full description for conditions and exceptions.
No pay amount identified in the saved description.
FL Miami - Aventura, FL 33180
Working pattern and location restrictions need checking in the full posting.
No clear work-authorization passage found. Eligibility is unconfirmed.
We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting