← back to jobs
> job detail
B
⚙️Data Engineer

Data Platform Lead (SÃO Jose Dos Campos, SP, BR, 12246-876)

Ball · SÃO Jose Dos Campos, SP, BR, 12246-876
// classified as
Data Engineer (Pipelines, infra, ingestion, ETL.)
posted
2d ago
location
SÃO Jose Dos Campos, SP, BR, 12246-876
languages
sql
tools
azure, databricks, delta
> stack
sqlazuredatabricksdelta
> description
<p> </p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">At Ball, integrity and trust are the foundation of who we are. Guided by our core values—"We Care. We Work. We Win.”—we create a culture where every voice matters and every idea drives progress.  </span></p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">Together with our global employees, customers, and partners, we’re turning bold sustainability goals into reality and shaping a future we can all be proud of. </span></p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">Create a new future. Apply Today. </span></p> <p> </p><p> </p> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span><strong>Summary of the Position: </strong>Work closely with data engineering teams, source data application teams and product owners to design, implement and support the data platform capabilities and analytics solutions that provide insights to make better decisions. Implement data platform, data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Azure Databricks, Unity Catalog, etc.). Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration), ingestion, preparation, data modeling, testing, CICD pipelines, performance tuning, deployments, consumption, BI, observability, alerting, production support. Collaborate within a team environment as well as work independently. Be a part of a DevOps team that completely owns and supports their product. Implement batch, streaming and CDC data pipelines using cloud technologies. Defines, promotes and enforces coding standards, engineering best practices and privacy and security guidelines across the platform. </span></span></p> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span><strong>Main Responsibilities: </strong></span></span></p> <ul> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Architectural ownership of data movement techniques including replication (CDC), messaging, and near real time data transfer. </span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Deep understanding of backend infrastructure and how platform services are built on top of it.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Knowledge of security approaches and tools for data storage, movement and access, including data catalog and access governance (Unity Catalog, Purview).</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Perform Data Acquisition requirements/information gathering and design cost-effective, reusable data acquisition patterns and ingestion accelerators. </span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Provides guidance regarding the use of data engineering tools, capability of tools to deliver information, and subject matter expertise regarding current systems and emerging technology.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Lead governance and enforcement of data pipeline patterns and standards — including pipeline scaffolding, shared libraries, CI/CD policies and deployment gates.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Analyze and recommend changes to increase productivity level of developers in working environment, treating friction removal for engineering teams as a platform deliverable.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Understanding user needs as well as understanding the technical requirements and limitations when building platform services.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Managing cross dependencies across teams to ensure alignment, as well as adjusting team directions when gaps exist.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Aligning with the strategy vision for various platform components and related services to increase adoption and deliver business results.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Defines and promotes best practices and design principles for data engineering pipelines development techniques and platform architecture independently and in partnership with other members of the data team - leadership.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Develops and proposes options with pros/cons and risk, and works with stakeholders to finalize the best solution that meets business needs.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Establishes credibility with partners while managing expectations. Ensures frequent, continuous and effective communications with team members, within IT, and with stakeholders to set expectations and negotiate priorities appropriately, via both formal and informal channels / mechanisms.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Understand the underlying technologies and applications utilized within specified area of responsibility to direct how to design, develop, test, and implement requirements.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Mentors and coaches engineers on platform standards and best practices, acting as the technical reference for the data platform.</span></span></li> </ul> <p> </p> <p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span><strong>Minimum Qualifications</strong></span></span></p> <ul> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Completed Bachelor's Degree</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Advanced/Fluent Level of English</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Progressive experience in software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions·</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Progressive experience of cloud development and data lake experience (prefer Microsoft Azure) including Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake and Azure Functions, CI/CD: GitHub, Azure DevOps, Bicep scripting.</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Experience in ADLS, Databricks (Unity Catalog, Delta Live Tables, Asset Bundles), ADF, Purview</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Demonstrated experience defining platform standards, reusable frameworks or shared libraries consumed by multiple engineering teams</span></span></li> <li><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt"><span>Strong SQL skills</span> </span></li> </ul><div> <div> <p> </p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">When submitting your application to Ball, we encourage you to emphasize your skills, experience, and qualifications that align with the role.  </span></p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">Ball Corporation is proud to be an Equal Opportunity Employer. We actively encourage applications from everybody. All qualified job applicants will receive consideration without regard to race, color, religion, creed, national origin, aboriginality, genetic information, ancestry, marital status, sex, sexual orientation, gender identity or expression, physical or mental disability, pregnancy, veteran status, age, political affiliation or any other non-merit characteristic.  </span></p> <p><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">Please note the advertised job title might vary from the job title on the contract due to local job title structure and global HR systems. </span></p> <p><span style="font-family:arial, helvetica, sans-serif"><span style="font-size:10.0pt"><span style="font-size:10.0pt;font-family:arial, helvetica, sans-serif">* This position will be posted internally for a minimum of 5 days and will remain open until filled or adjusted based on the volume of applicants. </span></span></span></p> <p><span style="font-family:arial, helvetica, sans-serif"><span style="font-size:10.0pt">No agencies please.</span> </span></p> <p><span style="font-family:arial, helvetica, sans-serif;font-size:10.0pt">Global Grade 12</span></p> </div> <p><span style="font-size:10.0pt">  </span></p> </div> <p> </p>