Back to jobs

AI Quality Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated
Apply at Aviva

Posting record

Report an error
Status in our records
Live
First seen by us
Oct 26, 202626 days ago
Recorded sightings
25
Last seen by us
Nov 16, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 26

Up longer than most. Similar jobs usually come down between day 1 and day 15.

At Aviva, jobs usually come down by about day 51.

From 1,376 similar postings that came down, and 15 of Aviva’s. Coming down is not always a hire.

Aviva is hiring

16 open jobs

Open jobs by the week we first saw them, last 12 weeks.

  • Hiring at a steady pace
  • Takes jobs down at a usual pace
  • 6% of open jobs were reposted
Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • Python
Where the posting names them
- Experience or strong interest in working with AI-powered solutions, either through developing, testing, evaluating or supporting them. - Good Python proficiency and experience writing clean, maintainable code for analysis, automation or testing purposes. - Interest in understanding how AI systems behave, how reliable they are, and how their quality can be measured.

Your next step

Complete your application on aviva.wd1.myworkdayjobs.com. The employer’s form will show what is required.

Applying through Workday

  • You create an account with each employer before you can upload anything. Every Workday employer has its own account, so one sign-up doesn’t carry over.
  • “Autofill with Resume” comes right after sign-in, before the My Information and My Experience steps. Check every field it fills in those steps, since that’s what recruiters see.
  • Your application status lives in that employer’s Candidate Home, under the same sign-in.

Already applied? Track this application

Job description

View original posting ↗

Hi, we're glad you're here! We are hiring to our Aviva Services Excellence Centre! Take a look at our job description - maybe it suits you or one of your friends? 

 

We are looking for an AI Quality Engineer to join Aviva Services Excellence Centre (ASEC) and help build confidence in the quality, safety and reliability of AI-powered products. 

This is a hands-on role for someone who enjoys understanding how AI systems behave, identifying weaknesses before they become customer problems, and creating reliable ways of measuring whether AI solutions are actually delivering the outcomes they were designed for. You will work across conversational AI, autonomous agents and other AI-powered systems, partnering closely with engineers, product teams and business stakeholders to ensure solutions are robust, trustworthy and ready for production use. 

 

What will you be doing? 

 

  • Translating business expectations, user outcomes and operational risks into measurable evaluation criteria. 
  • Defining what successful, partially successful and unsuccessful system behaviour looks like, including the gradient between clear success and clear failure. 
  • Designing evaluation approaches for conversational, multi-turn and non-deterministic AI systems. 
  • Building and maintaining representative evaluation datasets covering common, rare, boundary and high-risk scenarios. 
  • Assessing dataset quality, including coverage, class balance, duplicates, data leakage, label quality, synthetic-versus-production differences and dataset freshness. 
  • Selecting appropriate manual, deterministic, model-based and statistical evaluation methods. 
  • Analysing errors by category, user journey, risk level and likely root cause. 
  • Distinguishing model failures from failures in retrieval, chunking, ranking, prompts, tools, guardrails, integrations, source data and evaluators. 
  • Validating automated evaluators, including LLM-as-a-Judge, against human judgement. 
  • Detecting blind spots, noise, bias and misleading aggregation in evaluation results. 
  • Creating baselines, controlled comparisons and regression tests that allow meaningful comparison between system versions. 
  • Prioritising tests according to the probability and impact of failure rather than coverage alone. 
  • Communicating results, uncertainty, limitations and residual risks in a form that supports release and product decisions. 
  • Proactively identifying emerging failure modes based on system changes, production observations and research. 

 

What we're looking for: 

 

  • Professional experience in quality engineering, software testing, test automation, data science, software engineering or a related field (we can consider different seniority levels). 
  • Experience or strong interest in working with AI-powered solutions, either through developing, testing, evaluating or supporting them. 
  • Good Python proficiency and experience writing clean, maintainable code for analysis, automation or testing purposes. 
  • Interest in understanding how AI systems behave, how reliable they are, and how their quality can be measured. 
  • Strong analytical and problem-solving skills, with the ability to investigate issues and identify root causes. 
  • Ability to translate business objectives, customer outcomes and risks into practical evaluation approaches. 
  • Strong communication skills and the ability to explain findings to both technical and non-technical stakeholders. 
  • A curious, proactive mindset and a genuine interest in AI, emerging technologies and system robustness. 

 

Nice to have: 

 

  • Experience evaluating, testing or monitoring AI-powered systems in production environments. 
  • Working with structured data, especially JSON, logs and tabular evaluation results. 
  • Understanding of LLM behaviour, tokenisation, context limits, parameters and non-determinism. 
  • Understanding of multi-turn context, RAG, grounding, faithfulness, hallucinations, guardrails, attacks (like prompt injection etc.) and tool/function calling. 
  • Software engineering practices: Git, modular code, configuration management and automated tests. 

In Aviva Services Excellence Centre, we provide:  


  • Contract of employment  
  • Performance Bonus  
  • Private medical care (ENEL-MED)  
  • Cafeteria system of benefits (e.g. MultiSport card)  
  • Additional parent privileges:  
    - baby leave – 6 weeks leave for second parent  
    - shortened working time after parental leave  
  • Employer-funded group insurance  
  • Employee Shares Plan  
  • Extra day off for birthday  
  • Paid time off to volunteer  
  • Additional leave acquired over the years in the company (even 5 days more in a year)  
  • Wellbeing Leave - additional two weeks paid leave after 10 years of service  
  • Psychological support consultations  
  • Access to the e-learning platforms  
  • Internal employee referral program  
  • Hybrid working model from Poland with a few days in Warsaw office per month
  • Attractive office location in Warsaw - Gdański Business Center  
  • Additional entitlements for people with disabilities - Work Without Barriers  
  • Work environment that promotes diversity - Diversity Charter  


Do you see yourself in Aviva Services Excellence Centre? Be sure to apply!   

Aviva is for everyone!


We’ve been ranked the #1 Best Workplace in Poland for a second year in a row and a top choice for Millennials by Great Place to Work®! 


As a signatory to the Diversity Charter, Aviva applies a policy of equal treatment and creates a work environment that is friendly to people with disabilities. We do not require from candidates the date of birth, marital status and attached photos to your CV. We encourage all individuals regardless of gender to apply.  

Most of our people are smart working – spending also time in our office - combining the benefits of flexibility, with time together with colleagues.  

We’re inclusive - we welcome applications from people with diverse backgrounds and experiences.  

Excited but not sure you tick every box? Research tells us that women, particularly, feel this way. So, regardless of gender, why not apply and try! 

To find out more about current job offers at Aviva take a look here. 


 

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Poland - Warsaw - ASEC

- Internal employee referral program - Hybrid working model from Poland with a few days in Warsaw office per month - Attractive office location in Warsaw - Gdański Business Center
Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.