Description:
QA Automation Engineer (AI)
Yolk Recruitment are excited to be working with a global B2B SaaS technology business that’s continuing to invest heavily in AI-enabled platforms and modern engineering practices. Known for their collaborative culture and strong focus on quality, they’re offering an excellent opportunity for a Quality Assurance Engineer to play a key role in delivering reliable, production-ready AI solutions.
We’re looking for an experienced QA Engineer with a strong automation background and a genuine interest in AI-driven systems. You’ll work closely with Engineering, Product, and Data teams to define intelligent test strategies, build scalable automation, and ensure quality across complex, cloud-native SaaS platforms.
What you’ll be doing:
- Define and own AI-driven test strategies covering functional, non-functional, data, and model-level validation.
- Design, document, and maintain scalable test frameworks, reusable components, and comprehensive test cases.
- Build and maintain robust automated test suites using modern frameworks such as Playwright or Cypress.
- Validate AI and ML workflows, including model behaviour, output quality, bias, hallucination risks, and regression across versions.
- Test APIs, microservices, integrations, and data pipelines to ensure accuracy, security, and reliability.
- Embed automated testing into CI/CD pipelines, working closely with DevOps teams to support continuous testing.
- Support performance and scalability testing, including inference latency and system throughput.
The skills you’ll need:
- 5+ years’ experience in software quality engineering or SDET roles.
- Strong hands-on experience with modern test automation frameworks (Playwright, Cypress, or similar).
- Experience testing APIs, microservices, and distributed systems.
- Solid understanding of test architecture, automation design patterns, and QA best practices.
- Experience integrating automated tests into CI/CD pipelines.
- Familiarity with AI/ML concepts such as LLMs, prompts, inference, and model lifecycles.
- Experience using defect tracking and test management tools (JIRA, TestRail).
- Comfortable working in Agile/Scrum environments with cross-functional teams.
Company Benefits:
- Hybrid working model
- Integrated mental health and wellbeing support
- Annual leave starting at 3 weeks
- Wellness Days and an Annual Giving Day
- Comprehensive medical and dental coverage
- Company-wide end-of-year shutdown to fully switch off and recharge