Data Engineer

EXL Service · Hartford, Connecticut, United States

// classified as

Data Engineer (Pipelines, infra, ingestion, ETL.)

> description

Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.

a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }

Required Skills Databricks

Databricks Workspace
Databricks Jobs & Workflows
Delta Lake
Delta Live Tables (DLT)
Unity Catalog
Databricks SQL
MLflow (preferred)

Programming

PySpark
Python
SQL
Spark SQL

Data Engineering

ETL / ELT Design
Data Warehousing
Data Lakes
Batch Processing
Real-Time Streaming
Data Modeling

Cloud Platforms (Any One)

Microsoft Azure
Amazon Web Services (AWS)
Google Cloud Platform (GCP)

Tools

Git
Azure DevOps / Jenkins / GitHub Actions
Airflow (preferred)
Kafka/Event Hub (preferred)

Bachelor's/Master's in Engineering 2-5 years