Data Engineer – External Data Integrations

<p></p> <p>OTR Solutions is an innovator in the transportation industry providing a suite of factoring, fuel, and business management solutions. We help new and established companies get fast access to the funds they need for daily operations. As a Private Equity-backed FinTech company, we are scaling our technology and AI capabilities to deliver next-generation automation and document intelligence solutions for the freight and financial services industries.</p> <p><strong><em>OTR has been recognized as a “Top Workplace” by the Atlanta Journal-Constitution since 2016!</em></strong></p> <p>As a <strong>Data Engineer – External Data Integrations</strong>, you will design, build, and maintain scalable batch-oriented data pipelines that enable secure and reliable data exchange between OTR and external systems. You will play a key role in developing integrations with third-party platforms, supporting internal data operations, and ensuring data quality and observability across mission-critical workflows.</p> <p>This role combines data engineering and integration development, requiring close collaboration with Engineering, Business Intelligence, and business stakeholders to deliver scalable solutions that support automation, reporting, and business growth initiatives.</p> <p><strong>Please note: We do not sponsor work-related visas.**</strong></p> <p><strong>Responsibilities:</strong></p> <ul> <li>Design and build scalable batch ingestion pipelines from external systems, including APIs, SFTP sources, and databases</li> <li>Develop outbound data pipelines to securely publish structured data to external partners and third-party platforms</li> <li>Build, maintain, and optimize Azure Synapse pipelines and notebook-based transformations using PySpark and Spark SQL</li> <li>Orchestrate workflows using Azure Logic Apps, including scheduling, retries, monitoring, and alerting</li> <li>Design and implement data quality validation, observability, and monitoring frameworks to ensure pipeline reliability and SLA adherence</li> <li>Define and maintain schema standards, versioning strategies, and partner-facing data contracts</li> <li>Build secure integrations with third-party systems using modern authentication methods including OAuth and Azure Key Vault</li> <li>Partner with Engineering, Product, and Business Intelligence teams to define integration requirements and scalable data exchange patterns</li> <li>Troubleshoot complex integration issues and continuously improve performance, reliability, and maintainability of data pipelines</li> <li>Identify opportunities to automate and streamline data workflows across systems</li> </ul> <p><strong>What we look for:</strong></p> <ul> <li>4–7+ years of experience in Data Engineering, Integration Engineering, or similar technical roles</li> <li>Strong experience designing and maintaining batch-oriented data pipelines at scale</li> <li>Hands-on experience with Azure Synapse Analytics, Spark/Python, and Azure Logic Apps</li> <li>Experience integrating with REST APIs, SFTP workflows, and external data providers</li> <li>Strong SQL skills with experience transforming and modeling large datasets</li> <li>Understanding of data observability, monitoring, and reliability best practices</li> <li>Experience designing secure integrations and implementing authentication mechanisms for external systems</li> <li>Strong problem-solving skills with experience troubleshooting complex distributed data workflows</li> <li>Excellent communication skills with ability to work across technical and non-technical stakeholders</li> <li>Experience working in Agile environments</li> </ul> <p><strong>Nice to have:</strong></p> <ul> <li>Experience with Azure Data Lake and Parquet or Delta file formats</li> <li>Familiarity with Azure API Management (APIM)</li> <li>Experience implementing CI/CD pipelines using Azure DevOps</li> <li>Knowledge of data governance, lineage, and metadata management concepts</li> <li>Experience in FinTech, transportation, logistics, or other high-volume transactional environments</li> </ul> <p><strong>Perks and Benefits:</strong></p> <p>OTR provides a competitive, comprehensive compensation package for our full-time employees:</p> <ul> <li>Paid Certifications</li> <li>Certification Bonus</li> <li>Eligibility for Individual and Company bonus programs</li> <li>Medical, Dental, Vision, Life/AD&amp;D Insurance, Short-Term Disability</li> <li>Pet Insurance, Paid Family Leave, Employee Assistance Program</li> <li>Fully Paid Maternity Leave</li> <li>401(k) with Company Matching</li> <li>Generous PTO, Sick/Mental Health Days, Flex Holidays + Company Paid Holidays</li> <li>Travel Stipend to support Work Life Balance</li> <li>Leadership Development and Training</li> <li>Continuous Learning + Professional Enhancements</li> <li>Weekly Catered Lunches + Casual Dress Code</li> <li>Company Paid Fitness Membership</li> <li>Volunteer Days and Opportunities with Company-Partnered Charities</li> <li>Internal Inclusion Programs</li> </ul> <p>OTR’s mission is to create exceptional value for our clients by providing industry-leading financing and back-office solutions. Three pillars that are crucial to supporting that mission are outstanding customer service, technology that creates efficiency for ourselves and our customers, and a culture that provides employees the opportunity to achieve greatness.</p> <p>OTR Solutions is an Equal Opportunity Employer</p> <p></p> <p>&nbsp;</p>