AI Test Automation Consultant

Publiceringsdatum: 2025-12-19

Är du intresserad av att jobba inom data/it? Nu har du chansen att börja jobba som systemtestare hos Hays AB. Hays AB söker för närvarande efter personal på heltid för en tjänst 6 månader eller längre. Kolla in deras jobbannons för mer information.

Malmö är platsen där detta jobb har sin tjänsteort. Om du letar efter en spännande karriär inom systemtestare-branschen, har Hays AB just nu ett ledigt jobb som kan vara av intresse. Har du vad som krävs för att arbeta som systemtestare hos Hays AB? Ansök innan fredag den trettionde januari 2026 och ta reda på det!

Jobbannons

AI Test Automation Engineer for testing AI-driven conversational / chat-based solutions

Type of employment: contract

City of Work: Malmö, Skåne County, Sweden

Start date: 2026-02-02

End date: 2026-07-31

Availability: 100%

Ways of working: hybrid (50% on-site)

Role & tasks:

As an AI Test Automation Engineer in our team, you play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy.

You will perform the day-to-day test activities throughout the software delivery lifecycle. Your primary objective is to support the team in achieving quality-focused activities and goals with excellence, enabling essential confidence of the deliverables.

For this specific position, we require an automation-first mindset and hands-on experience testing non-deterministic AI systems, including conversational flows, retrieval grounding, and regression caused by prompt, configuration, or model changes.

To be successful in this role, we assume you have experience in various software development teams within large organizations, and you fulfill the following key responsibilities:

• Assess, plan, and execute the quality-focused work and processes on all test levels, including test automation, tailored to the context specific needs and risks
• Design, implement, and maintain automation-first test suites covering conversational flows, multi-turn context and RAG retrieval accuracy
• Perform API and integration testing for backend systems supporting the AI assistant
• Establish joint processes that transparently and continuously feedback progress, outcomes, risks and potential challenges of test activities to team members, with support of the Test lead
• Actively participate in the preparation, breakdown, and analysis of the planned solutions, providing inputs from a quality-, risk- and testability perspective
• Transparently feedback on the outcome of performed test activities and analyze the results
• Actively and continuous feedback reveals risks and defects according to set processes.
• Actively take part in discussions regarding defects mitigation
• Define test scenarios and produce the required test artefacts
• Implement, maintain and improve agreed test automation activities and outcomes.

Required qualifications:

• Proven hands-on experience

1 testing AI-driven conversational / chat-based solutions

2 designing, implementing, and maintaining automated test frameworks for AI / chat systems (manual testing limited to exploratory only)

3 testing RAG-based AI solutions, including retrieval accuracy, grounding, source relevance, and hallucination prevention

4 validating natural language interactions, including intent recognition, entity extraction, and multi-turn conversational context

5 testing non-deterministic AI behavior, defining acceptable response quality

6 testing prompt, configuration, and model version changes, including automated regression

7 testing API-based and backend integrations supporting AI agents

8 test planning, estimation, execution, reporting, and defect management for complex systems

9 working in agile software development in hybrid or cross-functional environments

10 using Atlassian Jira for test management, defect tracking, and reporting

• In-depth knowledge of software testing principles, automation strategies, and tools applied across the SDLC Strong understanding of data privacy, security, and compliance considerations
• Languages: fluent in English and Swedish

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.