Lead Client-Facing Architecture Discussions: Work directly with client stakeholders to understand business objectives, technical requirements, existing data environments, and architectural challenges. Translate these needs into practical, scalable data architecture solutions.
Define Enterprise Data Architecture: Design and recommend modern data platform architectures using Azure Databricks, Delta Lake, and cloud-based data engineering technologies, ensuring alignment with client objectives and enterprise standards.
Drive Technical Discovery and Solution Design: Facilitate technical workshops, discovery sessions, and architecture reviews to assess current-state environments, identify gaps, evaluate solution options, and define target-state architectures.
Provide Hands-On Technical Leadership: Develop, validate, and review data engineering solutions using SQL, Python/PySpark, Apache Airflow, and dbt Core, balancing architectural oversight with practical implementation expertise.
Guide Data Pipeline Development: Establish architecture and implementation standards for ingestion pipelines that integrate APIs, databases, files, and cloud data sources using Databricks-native capabilities such as Lakeflow Connect and Auto Loader.
Establish Data Architecture Standards: Define and promote reusable architectural patterns, implementation guidelines, and engineering best practices across client projects and distributed delivery teams.
Implement Medallion Architecture: Design and guide the implementation of Bronze, Silver, and Gold data layers to support reliable ingestion, standardized transformations, curated data products, and downstream analytics.
Drive Data Governance and Modeling: Establish appropriate practices for Unity Catalog, data access controls, lineage, semantic modeling, data discoverability, and enterprise data governance.
Oversee Technical Delivery and Quality: Review partner and engineering team deliverables, including architecture designs, code, data models, and pipelines, ensuring alignment with requirements, performance expectations, security standards, and long-term maintainability.
Champion Data Quality and Reliability: Define standards for data validation, automated testing, pipeline monitoring, error handling, and operational readiness to ensure reliable production data products.
Support CI/CD and Engineering Automation: Guide implementation of Git-based workflows, automated testing, CI/CD pipelines, and controlled deployment practices across development, testing, and production environments.
Advise on Performance and Cost Optimization: Evaluate platform performance, processing efficiency, scalability, and cloud consumption, recommending improvements that balance technical requirements with business value.
Drive AI-Assisted and Spec-Driven Development: Encourage the effective use of AI-assisted development tools and specification-driven engineering practices while maintaining architectural integrity, code quality, and delivery standards.
Coordinate Distributed Engineering Teams: Provide technical direction, resolve architectural questions, and facilitate collaboration between client stakeholders, internal engineers, and external technology partners.
Communicate Progress and Technical Risks: Clearly communicate architectural decisions, implementation trade-offs, dependencies, risks, and recommendations to both technical and non-technical stakeholders.
Support End-to-End Delivery: Maintain architectural ownership throughout the project lifecycle, from discovery and solution design through implementation, deployment, and ongoing optimization.