Senior Data Architect

- Develop dimensional data models using Kimball principles, including star schemas, fact and dimension tables, grain definition, conformed dimensions, and SCD Type I/II, supporting sales, contact center telephony, agent activity, quality evaluations, and operational reporting. - Build and optimize scalable data pipelines using Databricks, Delta Lake, Python, PySpark, Spark SQL, and T-SQL, applying incremental loading, watermarks, checkpoints, ACID transactions, partitioning, Z-ordering, and query optimization. - Integrate Snowflake sources, vendor flat files, SFTP transfers, and REST APIs, implementing secure connectivity, pagination, rate-limit handling, asynchronous processing, schema evolution, data normalization, and source-to-target reconciliation.

- Proven experience with REST APIs, vendor flat files, SFTP, data quality, reconciliation, schema drift, and high-volume data processing. - Proficiency in Python/PySpark and orchestration tools such as Azure Data Factory, Databricks Workflows, or equivalent platforms. - Familiarity with Azure Databricks, SQL Managed Instance, and Azure Key Vault, with strong skills in production support, performance optimization, technical documentation, and stakeholder collaboration.

We are looking for a Senior Data Architect to design and implement the end-to-end data platform for APEX, integrating call center telephony and quality data from the Genesys A3S Snowflake database and Verint Workforce Management (WFM) feeds. The role will focus on building a scalable, reliable, and auditable data architecture using Databricks, Delta Lake, and a Bronze/Silver/Gold (Medallion) architecture, delivering curated data through a Kimball-style dimensional reporting layer. The ideal candidate combines deep hands-on expertise in data warehouse modeling, lakehouse architecture, SQL, and production-grade data ingestion with the ability to make sound architectural decisions around data quality, performance, scalability, and operational resilience. You will define ingestion strategies, incremental loading patterns, batch controls, and data integrity standards while supporting the transition from existing CCARS pipelines to the new platform through a controlled parallel-run and decommissioning process. This role is suited to a Senior or Lead Data Architect with strong technical ownership who can translate complex business and reporting requirements into robust data solutions and clearly communicate architectural decisions to both engineering teams and business stakeholders.

- Strong expertise in Bronze/Silver/Gold architecture, Snowflake integration, Kimball dimensional modeling, star schemas, and SCD Type I/II. - Expert-level T-SQL and Spark SQL skills, including complex transformations, query optimization, SQL Server database design, indexing, and partitioning. - Hands-on experience with Delta Lake, incremental ingestion, watermarks, checkpoints, idempotency, retries, and pipeline recovery.

- Proficiency in Python/PySpark and orchestration tools such as Azure Data Factory, Databricks Workflows, or equivalent platforms. - Familiarity with Azure Databricks, SQL Managed Instance, and Azure Key Vault, with strong skills in production support, performance optimization, technical documentation, and stakeholder collaboration. Nice to have:

- Establish data quality, integrity, and audit controls, including deduplication, referential integrity, row counts, checksum/hash comparisons, late-arriving data handling, and detection and remediation of missing records, data drift, and schema changes. - Design and maintain reliable orchestration, monitoring, and recovery processes using Azure Data Factory, Databricks Workflows, or equivalent tools; optimize pipeline performance, scalability, and cost while supporting high-volume processing and production troubleshooting. - Collaborate with the CCARS pipeline team and engineering, reporting, QA, and business stakeholders to validate migrations, plan cutovers, decommission legacy pipelines, document architecture and operational procedures, and ensure functional, performance, security, and reliability requirements are met.

Job Description We are looking for a Senior Data Architect to design and implement the end-to-end data platform for APEX, integrating call center telephony and quality data from the Genesys A3S Snowflake database and Verint Workforce Management (WFM) feeds. The role will focus on building a scalable, reliable, and auditable data architecture using Databricks, Delta Lake, and a Bronze/Silver/Gold (Medallion) architecture, delivering curated data through a Kimball-style dimensional reporting layer. The ideal candidate combines deep hands-on expertise in data warehouse modeling, lakehouse architecture, SQL, and production-grade data ingestion with the ability to make sound architectural decisions around data quality, performance, scalability, and operational resilience. You will define ingestion strategies, incremental loading patterns, batch controls, and data integrity standards while supporting the transition from existing CCARS pipelines to the new platform through a controlled parallel-run and decommissioning process.

Qualifications - 10+ years of experience in enterprise data warehousing, data platforms, and lakehouse solutions, including 5+ years of hands-on Databricks and Delta Lake experience. - Strong expertise in Bronze/Silver/Gold architecture, Snowflake integration, Kimball dimensional modeling, star schemas, and SCD Type I/II.

- Experience with data observability, pipeline monitoring, and data quality controls. - Knowledge of Databricks and Delta Lake optimization, enterprise scheduling, and production support in multi-source environments. Additional Information

- Expert-level T-SQL and Spark SQL skills, including complex transformations, query optimization, SQL Server database design, indexing, and partitioning. - Hands-on experience with Delta Lake, incremental ingestion, watermarks, checkpoints, idempotency, retries, and pipeline recovery. - Proven experience with REST APIs, vendor flat files, SFTP, data quality, reconciliation, schema drift, and high-volume data processing.

Responsibilities: - Design and implement end-to-end Bronze/Silver/Gold data architecture for Genesys A3S Snowflake and Verint data sources, including data ingestion, transformation, validation, and consumption. - Develop dimensional data models using Kimball principles, including star schemas, fact and dimension tables, grain definition, conformed dimensions, and SCD Type I/II, supporting sales, contact center telephony, agent activity, quality evaluations, and operational reporting.

- Build and optimize scalable data pipelines using Databricks, Delta Lake, Python, PySpark, Spark SQL, and T-SQL, applying incremental loading, watermarks, checkpoints, ACID transactions, partitioning, Z-ordering, and query optimization. - Integrate Snowflake sources, vendor flat files, SFTP transfers, and REST APIs, implementing secure connectivity, pagination, rate-limit handling, asynchronous processing, schema evolution, data normalization, and source-to-target reconciliation. - Establish data quality, integrity, and audit controls, including deduplication, referential integrity, row counts, checksum/hash comparisons, late-arriving data handling, and detection and remediation of missing records, data drift, and schema changes.

- 10+ years of experience in enterprise data warehousing, data platforms, and lakehouse solutions, including 5+ years of hands-on Databricks and Delta Lake experience. - Strong expertise in Bronze/Silver/Gold architecture, Snowflake integration, Kimball dimensional modeling, star schemas, and SCD Type I/II. - Expert-level T-SQL and Spark SQL skills, including complex transformations, query optimization, SQL Server database design, indexing, and partitioning.