Senior Test Automation Engineer

<p>&nbsp;</p> <div data-olk-copy-source="MessageBody"><span data-olk-copy-source="MessageBody"><strong>At SOFICO</strong>, we're <strong>building the future of mobility</strong> through Miles, our market-leading platform for leasing, fleet, and mobility operations worldwide. As an international team, we combine innovation, collaboration, and ownership to deliver real impact for our customers, in a culture of continuous learning, mutual support, and shared success.</span></div> <div data-olk-copy-source="MessageBody">&nbsp;</div> <div data-olk-copy-source="MessageBody"><strong>From our office in Ghent</strong>, we are <strong>scaling our Data &amp; AI organization</strong>, the team behind SOFICO AI Cloud and the Miles Enterprise Agentic Platform (AutoPilot &amp; AutoRoute). Our platform combines AI, cloud-native technologies, and enterprise software, leveraging Java/Quarkus services, Python/LangGraph agents, Azure AI Foundry, Temporal workflows, and Langfuse observability.</div> <div>&nbsp;</div> <div><strong>As a Senior Test Automation Engineer</strong>, you will <strong>drive the quality and reliability of this platform</strong> by <strong>building and owning a robust test automation strategy across the entire AI ecosystem</strong>. Working closely with engineers across AI Runtime, Cloud Ops, API &amp; Saga, Knowledge, Governance, and Data teams, you will ensure that critical business flows, integrations, and AI-powered capabilities are validated through scalable, automated testing.</div> <div>&nbsp;</div> <div> <h1><strong>What </strong><strong>you’ll do</strong><strong>...</strong></h1> </div> <div><strong>Deterministic testing</strong>&nbsp;(classic, pass/fail quality gates)</div> <ul> <li><strong>Own and evolve the test automation strategy for the Data &amp; AI platform</strong> — unit, integration, contract, regression, and end-to-end — designing, building, and maintaining automated frameworks and suites integrated into CI/CD pipelines.</li> <li>Validate end-to-end business processes within sandboxed Miles environments, ensuring correctness, reliability, and safe failure handling.</li> <li>Develop <strong>API and contract testing approaches for distributed services and integrations.</strong></li> </ul> <div><strong>Non-deterministic testing</strong>&nbsp;(AI and agentic behavior)</div> <ul> <li> <div><strong>Design and own evaluation approaches for AI-powered and agentic capabilities</strong> where outcomes are probabilistic rather than pass/fail: LLM-as-a-judge setups, baseline/benchmark datasets, and process/quality metrics for agent behavior.</div> </li> <li> <div>Establish baselines and regression tracking for model and agent output quality over time, this alongside the deterministic CI gates.</div> </li> </ul> <div><strong>Platform-wide</strong></div> <ul> <li>Collaborate across engineering domains to ensure platform-wide quality and release confidence.</li> <li>Drive continuous improvement in test automation practices and tooling, and act as a mentor and quality advocate, helping teams adopt effective automated testing approaches.</li> </ul> <div>&nbsp;</div> <div> <h1><strong>What you bring</strong><strong>...</strong></h1> </div> <div><strong>We're looking for a strong overall profile</strong>, without expecting you will tick every box.</div> <div><strong>Please indicate in your application your current experience level </strong>(e.g. none / familiar / proficient / expert) <strong>for each of the areas below</strong>. This helps us understand your profile and have a more focused conversation.</div> <ul> <li>Test automation engineering: unit/integration/e2e frameworks, CI/CD integration</li> <li>Testing APIs, backend services, microservices, and distributed systems</li> <li>Programming in Java and/or Python, including typed schemas, mocking, and test-data setup/teardown</li> <li>Designing scalable automation frameworks from the ground up, and coaching others in their adoption</li> <li>Non-deterministic / AI evaluation testing: LLM-as-a-judge, benchmarking, quality metrics for agentic systems (<em>plus</em>)</li> <li>Workflow orchestration platforms, cloud-native applications, and LLM/agentic systems (<em>plus</em>)</li> <li>Tooling such as Playwright, Kubernetes, and modern DevOps practices (<em>advantage</em>)</li> </ul> <div><strong>An analytical mindset, attention to detail, and a genuine drive to improve software quality matter as much as any single line above.</strong></div> <div>&nbsp;</div> <h1><strong>What's in it for you…&nbsp;</strong></h1> <ul> <li>Competitive salary package.</li> <li>Meal allowance provided per working day.</li> <li>Fully covered private health insurance, so you can focus on what matters most.</li> <li>Hybrid working and flexible hours, giving you the freedom to shape your workday.</li> <li>A modern co-working space offering a comfortable working environment.</li> <li>A structured onboarding program from day one, with a dedicated coach to help you get up to speed and grow in your role.</li> <li>Regular opportunities to connect beyond day-to-day work — casual drinks, team activities, and company-wide events.</li> </ul> <p><strong>Ready to build the secure and deterministic capabilities behind the next generation of mobility software? Join SOFICO and let's shape what's next together!</strong></p>