Senior Data Engineer (Databricks, Spark)

<h3>Why Join Exadel</h3> <p>We’re an AI-first global tech company with 25+ years of engineering leadership, 2,000+ team members, and 500+ active projects powering Fortune 500 clients, including HBO, Microsoft, Google, and Starbucks.</p> <p>From AI platforms to digital transformation, we partner with enterprise leaders to build what’s next.<br>What powers it all? Our people are ambitious, collaborative, and constantly evolving.</p> <h3>About the Client</h3> <p>A leading global digital banking platform and one of the largest neobanks in Latin America, headquartered in Brazil. The company provides a mobile-first suite of financial services—including credit cards, savings accounts, and investments—designed to eliminate bureaucracy and high fees. By leveraging advanced data analytics and a customer-centric digital infrastructure, the organization delivers transparent and accessible financial solutions to millions of users across Brazil, Mexico, and Colombia.</p> <h3>What You’ll Do</h3> <ul> <li>Design, develop, and maintain scalable data transformation pipelines integrating SaaS platforms, APIs, batch processing, and enterprise data sources.</li> <li>Process, standardize, and optimize structured and semi-structured (JSON) datasets from heterogeneous systems.</li> <li>Design and implement dimensional data models, including Fact, Dimension, and Event tables following Data Warehouse best practices.</li> <li>Build trusted analytical datasets and business metrics that serve as the organization's Single Source of Truth.</li> <li>Develop incremental, idempotent, and scalable data pipelines using Databricks and Apache Spark.</li> <li>Optimize Spark workloads for large-scale distributed data processing.</li> <li>Implement automated data quality validation, monitoring, alerting, and operational support processes.</li> <li>Validate data reconciliation between legacy and modern cloud platforms throughout migration initiatives.</li> <li>Produce technical documentation and facilitate knowledge transfer to internal engineering teams.</li> <li>Collaborate with cross-functional stakeholders to deliver scalable, high-quality data solutions.</li> </ul> <h3>What You Bring</h3> <ul> <li>Extensive professional experience in Data Engineering or Analytics Engineering.</li> <li>Strong hands-on experience with Databricks, including Workflows, Jobs, and Unity Catalog.</li> <li>Advanced experience developing with Apache Spark (PySpark or Scala).</li> <li>Experience processing large-scale datasets containing hundreds of millions of records.</li> <li>Strong knowledge of Delta Lake and/or Apache Iceberg.</li> <li>Advanced SQL skills with experience writing highly optimized queries.</li> <li>Strong understanding of dimensional data modeling, including: Fact and Dimension tables, Slowly Changing Dimensions (SCD), Grain definition.</li> <li>Experience building incremental and idempotent data pipelines.</li> <li>Experience with Git, CI/CD pipelines, automated testing, and modern software engineering best practices.</li> <li>Strong analytical and problem-solving skills.</li> </ul> <h3>Nice to have</h3> <ul> <li>Experience supporting multi-cloud migration initiatives (GCP to AWS).</li> <li>Experience with AWS services including S3, Glue, and Lake Formation.</li> <li>Familiarity with Google Cloud Platform (GCP).</li> <li>Experience working with sensitive HR or People data while ensuring compliance with LGPD, GDPR, or similar regulations.</li> <li>Understanding of Semantic Layer architecture and modern Lakehouse concepts.</li> <li>Experience integrating REST APIs and processing JSON data.</li> </ul> <h3>English level</h3> <p>Advanced English proficiency</p> <p><strong>Work Type:</strong> Hybrid</p> <p><strong>Location:</strong> São Paulo, Brazil</p> <h3>Legal &amp; Hiring Information</h3> <ul> <li>Exadel is proud to be an Equal Opportunity Employer committed to inclusion across minority, gender identity, sexual orientation, disability, age, and more</li> <li>Reasonable accommodations are available to enable individuals with disabilities to perform essential functions</li> <li>Please note: this job description is not exhaustive. Duties and responsibilities may evolve based on business needs</li> <li>Compensation details are shared with candidates at the early stage of the recruitment process.</li> <li>The offer is not binding until a signed contract is in place.</li> </ul> <h3>Your Benefits at Exadel</h3> <p>Exadel benefits vary by location and contract type. Your recruiter will fill you in on the details.</p> <ul> <li>International projects</li> <li>In-office, hybrid, or remote flexibility</li> <li>Medical healthcare</li> <li>Recognition program</li> <li>Ongoing learning &amp; reimbursement&nbsp;</li> <li>Well-being program</li> <li>Team events &amp; local benefits&nbsp;</li> <li>Sports compensation&nbsp;</li> <li>Referral bonuses&nbsp;</li> <li>Top-tier equipment provision</li> </ul> <h3>Exadel Culture</h3> <p>We lead with trust, respect, and purpose. We believe in open dialogue, creative freedom, and mentorship that helps you grow, lead, and make a real difference. Ours is a culture where ideas are challenged, voices are heard, and your impact matters.</p>