Back to jobs

AI Quality Engineer

Pay
Pay not listed
Work setting
Not stated
Employment
Not stated

What you’ll work on

Full posting

In the capacity of an AI Quality Engineer, you are responsible for architecting and managing the intelligent systems that uphold our platform's integrity.

  • Develop rigorous evaluation frameworks for AI processes, auditing metrics such as precision, latency, and operational expenditure to ensure output reliability.

  • Drive quality intelligence reporting initiatives, replacing static documentation with interactive dashboards highlighting ROI and automation efficacy.

  • Partner with Backend, DevOps, QA, and Product teams to identify and automate high-friction or repetitive activities across the software development lifecycle.

From the employer’s posting
In the capacity of an AI Quality Engineer, you are responsible for architecting and managing the intelligent systems that uphold our platform's integrity. Moving beyond manual verification, you will engineer agentic processes and automated solutions to create, sustain, and evaluate test scenarios, while proactively identifying potential issues through production monitoring. By merging LLM capabilities with our core technology—including Python test Suites, Playwright, GitHub Actions, Jira, Sentry, and Grafana—you will develop the essential tooling that scales our quality assurance and engineering efforts. This role works closely with Backend, DevOps, development teams, and product stakeholders, leveraging existing CI/CD, cloud, API, and observability infrastructure to build and own the quality engineering automation layer throughout the software development lifecycle.
Construct automated anomaly detection pipelines that link performance shifts and user issues across monitoring tools, delivering actionable root-cause intelligence. Develop rigorous evaluation frameworks for AI processes, auditing metrics such as precision, latency, and operational expenditure to ensure output reliability. Treat prompt design and context engineering as core technical disciplines, ensuring they are version-controlled and thoroughly validated like traditional codebase components.
Modernize test data orchestration, automating the creation and masking of high-fidelity datasets for non-production environments. Drive quality intelligence reporting initiatives, replacing static documentation with interactive dashboards highlighting ROI and automation efficacy. Partner with Backend, DevOps, QA, and Product teams to identify and automate high-friction or repetitive activities across the software development lifecycle.
Drive quality intelligence reporting initiatives, replacing static documentation with interactive dashboards highlighting ROI and automation efficacy. Partner with Backend, DevOps, QA, and Product teams to identify and automate high-friction or repetitive activities across the software development lifecycle. Deploy AI capabilities while adhering to regulatory and security standards like ISO 27001, maintaining the strict confidentiality of credentials and production assets.

What you’ll bring

All qualifications

Core experience

  • Expertise in LLM API implementation, including advanced prompt engineering, RAG, tool calling, and agentic workflows.
  • Deep understanding of API orchestration and designing automated systems that interact with live infrastructure.
  • Hands-on experience managing CI/CD pipelines, specifically utilizing GitHub Actions.
  • Familiarity with Playwright or similar E2E frameworks, with the ability to optimize suite stability.
  • Knowledge of LLM-specific security vectors, including prompt injection mitigation and automated data sanitization.

Preferred experience

  • Knowledge of JavaScript or TypeScript.
  • Experience with AI observability tools such as LangSmith, Promptfoo, or DeepEval.
  • Proficiency in monitoring platforms like Grafana and Sentry for proactive alerting.
  • Experience working within highly regulated environments such as ISO 27001 or PCI-DSS.
Qualification wording
Expertise in LLM API implementation, including advanced prompt engineering, RAG, tool calling, and agentic workflows.
Deep understanding of API orchestration and designing automated systems that interact with live infrastructure.
Hands-on experience managing CI/CD pipelines, specifically utilizing GitHub Actions.
Familiarity with Playwright or similar E2E frameworks, with the ability to optimize suite stability.
Knowledge of LLM-specific security vectors, including prompt injection mitigation and automated data sanitization.
Knowledge of JavaScript or TypeScript.
Experience with AI observability tools such as LangSmith, Promptfoo, or DeepEval.
Proficiency in monitoring platforms like Grafana and Sentry for proactive alerting.
Experience working within highly regulated environments such as ISO 27001 or PCI-DSS.
Apply at Drvn-Jobs

Posting record

Report an error
Status in our records
Live
First seen by us
Sep 18, 202664 days ago
Recorded sightings
24
Last seen by us
Nov 22, 2026
Employer says posted
Sep 8, 2026

These dates show when we found the posting. Check the employer’s website to confirm it is still accepting applications.

How this job compares

Time since we first saw it

Day 64

Up longer than most. Similar jobs usually come down between day 1 and day 15.

From 1,368 similar postings that came down. Coming down is not always a hire.

Drvn-Jobs is hiring

1 open job

Open jobs by the week we first saw them, last 12 weeks.

Hiring record

See how this role fits your experience

Add your resume and we’ll mark which of these tools you already use, and point out anything in the posting that could rule you out.

  • JavaScript
  • Python
  • SQL
  • TypeScript
  • Grafana
Where the posting names them
Preferred Skills - Knowledge of JavaScript or TypeScript. - Experience with AI observability tools such as LangSmith, Promptfoo, or DeepEval.
Role Description In the capacity of an AI Quality Engineer, you are responsible for architecting and managing the intelligent systems that uphold our platform's integrity. Moving beyond manual verification, you will engineer agentic processes and automated solutions to create, sustain, and evaluate test scenarios, while proactively identifying potential issues through production monitoring. By merging LLM capabilities with our core technology—including Python test Suites, Playwright, GitHub Actions, Jira, Sentry, and Grafana—you will develop the essential tooling that scales our quality assurance and engineering efforts. This role works closely with Backend, DevOps, development teams, and product stakeholders, leveraging existing CI/CD, cloud, API, and observability infrastructure to build and own the quality engineering automation layer throughout the software development lifecycle. Key Responsibilities
- A minimum of three years of professional experience in software, automation, or platform engineering. - Advanced proficiency in Python for architecting robust tools and services rather than basic scripting. - Expertise in LLM API implementation, including advanced prompt engineering, RAG, tool calling, and agentic workflows.
- Hands-on experience managing CI/CD pipelines, specifically utilizing GitHub Actions. - Command of SQL for direct data validation and database integrity checks. - Familiarity with Playwright or similar E2E frameworks, with the ability to optimize suite stability.
- Experience with AI observability tools such as LangSmith, Promptfoo, or DeepEval. - Proficiency in monitoring platforms like Grafana and Sentry for proactive alerting. - Execution of load and performance testing using Locust, k6, or similar utilities.

Your next step

Complete your application on ats.rippling.com. The employer’s form will show what is required.

Applying through Rippling

  • “The résumé will be parsed to fill in the application details”: check what it filled before you send.

Already applied? Track this application

Job description

View original posting ↗

Moveo Technologies Corp. (drvn)


As the first and currently the main brand of Moveo Technologies Corporation, drvn provides premium, global, private passenger transportation and logistics services. Providing technology solutions and passenger transportation services for complex ground environments and projects is the company's primary focus. 

Role Description

In the capacity of an AI Quality Engineer, you are responsible for architecting and managing the intelligent systems that uphold our platform's integrity. Moving beyond manual verification, you will engineer agentic processes and automated solutions to create, sustain, and evaluate test scenarios, while proactively identifying potential issues through production monitoring. By merging LLM capabilities with our core technology—including Python test Suites, Playwright, GitHub Actions, Jira, Sentry, and Grafana—you will develop the essential tooling that scales our quality assurance and engineering efforts. This role works closely with Backend, DevOps, development teams, and product stakeholders, leveraging existing CI/CD, cloud, API, and observability infrastructure to build and own the quality engineering automation layer throughout the software development lifecycle.


Key Responsibilities 

  • Architect, implement, and maintain AI-enabled workflows and agents that automate testing, triage, and quality analysis across the software development lifecycle.
  • Integrate LLM-based workflows with internal systems through APIs and MCP connectors, including GitHub, Jira, CI/CD pipelines, and observability platforms.
  • Engineer AI-driven test lifecycle management systems that extract scenarios from documentation, utilize self-healing mechanisms, and optimize Playwright performance.
  • Construct automated anomaly detection pipelines that link performance shifts and user issues across monitoring tools, delivering actionable root-cause intelligence.
  • Develop rigorous evaluation frameworks for AI processes, auditing metrics such as precision, latency, and operational expenditure to ensure output reliability.
  • Treat prompt design and context engineering as core technical disciplines, ensuring they are version-controlled and thoroughly validated like traditional codebase components.
  • Modernize test data orchestration, automating the creation and masking of high-fidelity datasets for non-production environments.
  • Drive quality intelligence reporting initiatives, replacing static documentation with interactive dashboards highlighting ROI and automation efficacy.
  • Partner with Backend, DevOps, QA, and Product teams to identify and automate high-friction or repetitive activities across the software development lifecycle.
  • Deploy AI capabilities while adhering to regulatory and security standards like ISO 27001, maintaining the strict confidentiality of credentials and production assets.
  • Ensure dedicated focus on AI architecture and tooling by balancing proactive system development (80%) with targeted support for existing manual QA efforts (20%).
  • Develop systems that effectively hand off complex anomalies to the Human QA team, ensuring AI empowers the critical peer-review lifecycle.

Qualifications

  • A minimum of three years of professional experience in software, automation, or platform engineering.
  • Advanced proficiency in Python for architecting robust tools and services rather than basic scripting.
  • Expertise in LLM API implementation, including advanced prompt engineering, RAG, tool calling, and agentic workflows.
  • Deep understanding of API orchestration and designing automated systems that interact with live infrastructure.
  • Hands-on experience managing CI/CD pipelines, specifically utilizing GitHub Actions.
  • Command of SQL for direct data validation and database integrity checks.
  • Familiarity with Playwright or similar E2E frameworks, with the ability to optimize suite stability.
  • The ability to evaluate non-deterministic AI outputs through rigorous engineering and validation frameworks.
  • Knowledge of LLM-specific security vectors, including prompt injection mitigation and automated data sanitization.


Preferred Skills

  • Knowledge of JavaScript or TypeScript.
  • Experience with AI observability tools such as LangSmith, Promptfoo, or DeepEval.
  • Proficiency in monitoring platforms like Grafana and Sentry for proactive alerting.
  • Execution of load and performance testing using Locust, k6, or similar utilities.
  • Competence in data lifecycle management, including ETL processes and anonymization.
  • Advanced usage of Jira and integrated test management software.
  • Experience working within highly regulated environments such as ISO 27001 or PCI-DSS.
  • Background in mentorship or leadership for quality assurance projects.


Team Collaboration

You will work closely with the IT & Development team, collaborating with QA engineers, designers, developers, data engineers, and other departments such as operations to ensure a seamless customer experience.

Successful candidates will initially participate in our standard QA onboarding shadowing process to deeply understand our existing software development lifecycle before implementing AI-driven optimizations.

Demand for AI Engineer roles

New AI Engineer postings at the employers we follow are up 340% over the last 6 weeks compared with the 6 before.

Weekly new AI Engineer postings at the same employers, from the week of August 17 to the week of November 9. The fewest in a week was 78, the most 803, and the latest week had 438.
August 17Last week

Each bar is one week of new postings. The darkest bars are the last 6 weeks.

Counted from the hiring pages we’ve followed for at least five weeks, so employers we add don’t look like growth. Updated weekly.

About the role

We file this job under AI Engineer, by the work the posting describes.

AI engineers build products on top of AI models that already exist, most often large language models: they connect a model to a company's data and tools and ship the assistants, agents and search features people use.

Postings ask for strong Python or TypeScript, experience with model APIs, retrieval and agent frameworks, and ways to test whether the model's answers are good enough.

An ML engineer trains and serves models; an AI engineer usually starts from a model someone else trained and builds the product around it, though titles often mix the two.

Source details

View original posting ↗

Source notes

Source excerpts

Selected passages from the saved posting. Check the full description for conditions and exceptions.

Pay

No pay amount identified in the saved description.

Location & working pattern

Rosario, Argentina

Working pattern and location restrictions need checking in the full posting.

Work authorization

No clear work-authorization passage found. Eligibility is unconfirmed.

Find answers in the posting

AI
How answers work

AI selects complete passages from this posting. Check them for conditions and exceptions.

Uses this posting and your question. No profile needed.