Back to jobs

Master Data Developer (Databricks), Colombia

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting
  • Migrate Databricks notebooks, jobs and DLT pipelines to AWS

  • Convert Delta tables to Iceberg format on S3 with incremental sync

  • Refactor /mnt/ DBFS storage paths to S3-backed locations

  • Validate migrations with row counts, checksums and sample queries

  • Recreate secret scopes in AWS Secrets Manager

From the employer’s posting
Notebook and job migration: notebooks, DAG pipelines, DLT pipelines
Data migration execution: Deltalake format to Iceberg format on S3 (Delta tables, raw files), incremental sync
Storage path refactoring: /mnt/ DBFS references to S3-backed locations
Validation: row counts, checksums, sample queries, ETL runtime comparison
Secrets: recreate secret scopes in AWS Secrets Manager

Tools in this posting

  • Java
  • Python
  • Scala
  • SQL
  • AWS
  • Databricks
  • Delta Lake
  • S3
  • Spark
  • PySpark
Source — Tool mentions in context
- AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, LakeFormation and EMR - Languages: Spark SQL, PySpark, Java, Python and Scala - Agile pod delivery: daily ticket updates, standups, code review
- Validation: row counts, checksums, sample queries, ETL runtime comparison - Secrets: recreate secret scopes in AWS Secrets Manager - AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, LakeFormation and EMR
- Secrets: recreate secret scopes in AWS Secrets Manager - AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, LakeFormation and EMR - Languages: Spark SQL, PySpark, Java, Python and Scala
Nice to Have: Databricks Certified Consultant (Associate/Professional); DBR to EMR on AWS migration experience #LI-LO1
Requirements: - Hands-on Databricks migration with the databricks/migrate tool (notebooks, jobs, clusters, secrets, ACLs), Unity catalog to Glue Catalog - Notebook and job migration: notebooks, DAG pipelines, DLT pipelines
- Storage path refactoring: /mnt/ DBFS references to S3-backed locations - Data migration execution: Deltalake format to Iceberg format on S3 (Delta tables, raw files), incremental sync - Streaming: Auto Loader / DLT checkpoint re-bootstrap, event_id dedup
- Notebook and job migration: notebooks, DAG pipelines, DLT pipelines - Storage path refactoring: /mnt/ DBFS references to S3-backed locations - Data migration execution: Deltalake format to Iceberg format on S3 (Delta tables, raw files), incremental sync
Check the employer’s page ↗

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 28, 202624 days ago
Recorded sightings
27
Last seen by us
Nov 21, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 24

Similar jobs usually come down between day 6 and day 52.

At Ciandt, jobs usually come down by about day 13.

From 2,085 similar postings that came down, and 293 of Ciandt’s. Coming down is not always a hire.

Ciandt is hiring

22 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down quickly
Hiring record

Your next step

Check the employer’s posting for the current role and application details.

Applying through Lever

  • No account needed: one form, and Lever reads your resume into the profile recruiters search.

Already applied? Track this application

Job description

View original posting ↗

At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.

With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.

We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.


As CI&T grows, we seek a talented, motivated, and experienced Data Developer to join our team and build robust data-driven solutions for our customers. This role is pivotal in designing, developing, and maintaining scalable data infrastructure and pipelines that enable our data initiatives to thrive. 

The Data Developer will be responsible for implementing and optimizing data architectures, ensuring data quality and reliability, and collaborating closely with analytics and business teams to deliver high-performance data solutions. This position requires strong technical expertise in data engineering, cloud platforms, and modern data stack technologies, combined with the ability to translate business requirements into effective technical solutions.

Responsibilities:

  • Data Pipeline Development: Build, optimize, and maintain scalable data pipelines and ETL/ELT processes to support analytics and business intelligence needs.
  • Data Architecture Implementation: implement data architectures, including data lakes, warehouses, and integration layers that support the organization's data strategy and modernization.
  • Data Quality & Governance: Implement data quality checks, validation processes, and monitoring systems to ensure data accuracy, consistency, and reliability.
  • Integration & API Development: Develop and maintain integrations between various data sources, third-party tools, and analytics platforms.
  • Collaboration: Work closely with Data & Analytics Managers and business stakeholders to understand requirements and deliver technical solutions that enable data-driven decision making.
  • Performance Optimization: Monitor and optimize data pipeline performance, query efficiency, and storage costs to ensure scalable and cost-effective solutions.
  • Documentation: Create and maintain comprehensive technical documentation for data architectures, pipelines, and processes.
  • Data Security: Implement security best practices and ensure compliance with data privacy regulations across all data systems.
  • Powered by AI: Leverage AI tools and automation to enhance data engineering workflows and productivity.
 

Requirements:

  • Hands-on Databricks migration with the databricks/migrate tool (notebooks,
    jobs, clusters, secrets, ACLs), Unity catalog to Glue Catalog
  • Notebook and job migration: notebooks, DAG pipelines, DLT pipelines
  • Storage path refactoring: /mnt/ DBFS references to S3-backed locations
  • Data migration execution: Deltalake format to Iceberg format on S3  (Delta tables, raw files), incremental sync
  • Streaming: Auto Loader / DLT checkpoint re-bootstrap, event_id dedup
  • Validation: row counts, checksums, sample queries, ETL runtime comparison
  • Secrets: recreate secret scopes in AWS Secrets Manager
  • AWS services: S3, Glue, Secrets Manager, IAM basics, Athena, LakeFormation and
    EMR
  • Languages: Spark SQL, PySpark, Java, Python and Scala
  • Agile pod delivery: daily ticket updates, standups, code review
 
 
Nice to Have:
Databricks Certified Consultant (Associate/Professional); DBR to EMR on AWS migration experience
 
 
 
 
#LI-LO1
Our benefits include:
 
- Premium Healthcare
- Meal voucher
- Maternity and Parental leaves
- Mobile services subsidy
- Sick pay-Life insurance
- CI&T University   
- Colombian Holidays
- Paid Vacations
And many others. 
 
 
Collaboration is our superpower, diversity unites us, and excellence is our standard. 
We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.

Employment type

Homeoffice

Demand for Data Governance roles

New Data Governance postings at the employers we follow are up 164% over the last 6 weeks compared with the 6 before.

Weekly new Data Governance postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 75, the most 445, and the latest week had 321.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under Data Governance, by the work the posting describes.

Data governance staff keep a company's data accurate, documented and used within the rules. They agree what key fields mean, set up quality checks, track who owns each dataset and look after master data.

Postings ask for SQL, a governance tool such as Collibra or Informatica, knowledge of privacy and data rules, and a lot of work with other teams.

A data engineer builds the systems that move data; governance staff set and check the standards that data has to meet.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Colombia

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

AI answers unavailable

We couldn’t identify enough role detail in this saved description to support an AI answer. Read the full posting