Sr. Data Engineer

<div class="content-intro"><p>Orion Innovation is a premier, award-winning, global business and technology services firm.&nbsp; Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.&nbsp; We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.</p></div><p><strong>Job Overview:<br><br></strong>We are seeking a talented Data Engineer with over 5 years of experience in Databricks, Delta Lake, and Azure Data Services. The ideal candidate will have hands-on expertise in building scalable data ingestion, transformation, and AI-driven data pipelines using our agents, contributing to our data-driven decision-making processes.</p> <p><strong>Key Responsibilities:</strong></p> <ul> <li>Build and maintain data ingestion and transformation pipelines.</li> <li>Implement ingestion, transformation, and validation agents.</li> <li>Optimize Spark workloads for improved performance and efficiency.</li> <li>Implement data quality measures and testing hooks to ensure data integrity.</li> <li>Support Continuous Integration/Continuous Deployment (CI/CD) deployments.</li> </ul> <p><strong>Qualifications:</strong></p> <ul> <li>5+ years of experience in Databricks, Delta Lake, and Azure Data Services.</li> <li>Proven expertise in building scalable data pipelines.</li> <li>Strong understanding of data quality and testing methodologies.</li> <li>Familiarity with CI/CD processes and tools.</li> <li>Excellent problem-solving and analytical skills.</li> <li>Strong communication and collaboration skills.</li> </ul> <p style="text-align: left;">&nbsp;</p> <p style="text-align: left;">&nbsp;</p><div class="content-conclusion"><p>Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.</p> <p>Candidate Privacy Policy</p> <p>Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This&nbsp;<a href="https://www.orioninc.com/candidate-data-privacy-policy/">Candidate Privacy Policy (orioninc.com)</a> (“Notice”) explains:</p> <ul> <li>What information we collect during our application and recruitment process and why we collect it;</li> <li>How we handle that information; and</li> <li>How to access and update that information.</li> </ul> <p>Your use of Orion services is governed by any applicable terms in this notice and our general&nbsp;<a href="https://www.orioninc.com/privacy-policy/">Privacy Policy</a>.</p> <p>&nbsp;</p></div>