Lead / Principal Data Engineer

<p></p> <div> <p><strong>Job Title:</strong> Lead / Principal Data Engineer - DBT &amp; Databricks<br><strong>Key Skills:</strong> DBT, Azure Databricks, SQL, Python, Delta Lake, AI-Assisted Development<br><strong>Experience:</strong> 5+ YOE.<br><strong>Location:</strong> Costa Rica, Peru, Colombia, and Bolivia.<br><strong>Mode:</strong> Remote.</p> <p>We at Coforge are hiring <strong>Lead / Principal Data Engineer - DBT &amp; Databricks (#22555)</strong> with the following skill set.</p> <p><strong>Key Responsibilities</strong><br>· Design, build, and maintain DBT models on Azure Databricks using Delta Lake, Unity Catalog, and Medallion Architecture principles.<br>· Deliver curated Gold-layer data domains to production standards in regulated enterprise environments.<br>· Leverage AI-assisted development tools such as Claude Code for model generation, refactoring, documentation, debugging, and engineering acceleration.<br>· Establish comprehensive DBT testing strategies, including schema validation, data quality testing, unit testing, and automated quality controls.<br>· Work within fast-paced, CI/CD-driven delivery environments using pull request workflows and automated quality gates.<br>· Curate datasets, semantic definitions, and business terminology to support Databricks Genie and natural-language analytics initiatives.<br>· Define and enforce data contracts, domain ownership, and governance standards.<br>· Implement data observability, monitoring, and root-cause analysis practices across data platforms.<br>· Drive modernization and migration initiatives through AI-assisted Data Engineering approaches.<br>· Contribute to engineering playbooks, standards, and enablement programs related to DBT, Databricks, and AI-powered development.<br>· Measure and improve AI-generated code adoption, quality, productivity, and delivery outcomes.</p> <p><strong>Required Skills &amp; Qualifications</strong><br>· 5+ years of experience in Data Engineering.<br>· At least 2 years of hands-on experience building and operating production-grade DBT projects, including models, tests, macros, snapshots, and large-scale refactoring.<br>· Strong SQL skills and solid Python programming experience.<br>· Hands-on experience with Azure Databricks, including Delta Lake, Unity Catalog, and Medallion Architecture.<br>· Strong knowledge of DBT testing frameworks, data validation, and quality assurance best practices.<br>· Familiarity with tools such as dbt-expectations, Great Expectations, or Delta Live Tables expectations.<br>· Experience working with Git-based pull request workflows, code reviews, and CI/CD deployment pipelines.<br>· Experience using AI-powered development tools such as Claude Code, GitHub Copilot, Cursor, or similar solutions.<br>· Ability to independently own data domains and collaborate directly with business stakeholders.<br>· Strong communication, analytical, and problem-solving skills.</p> <p><strong>Preferred Skills</strong><br>· Experience curating Databricks Genie environments or building semantic layers for natural-language analytics.<br>· Experience within Insurance or Financial Services domains.<br>· Experience working with policy, claims, exposure, or regulatory reporting data.<br>· Hands-on experience with PySpark for large-scale data transformations.<br>· Experience with Databricks Workflows, Airflow, or similar orchestration platforms.<br>· DBT and/or Databricks certifications.<br>· Experience implementing AI-driven modernization and migration programs.</p> <p><strong>Posted On:</strong> 14-08-2026</p> <p>At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.</p> </div>