
Senior/Lead Quality Engineer - Chatbot
Mimica
Senior/Lead Quality Engineer - Chatbot
Mimica, an AI-powered process intelligence platform, is seeking a Senior/Lead Quality Engineer to establish quality foundations for a new Chatbot product team. The role involves developing test strategies, evaluating LLM-based systems, and collaborating with software and ML engineers in a fully remote, globally distributed environment.
Senior/Lead Quality Engineer - Chatbot
Mimica, an AI-powered process intelligence platform, is seeking a Senior/Lead Quality Engineer to establish quality foundations for a new Chatbot product team. The role involves developing test strategies, evaluating LLM-based systems, and collaborating with software and ML engineers in a fully remote, globally distributed environment.
Salary
Core Qualifications
Technical (Must-have)
Soft Skills
Preferred Qualifications
Technical (Nice-to-have)
Key Responsibilities
- Develop and evolve quality practices, test strategy, and release processes for the Chatbot product.
- Help establish and run an output-evaluation framework for assessing Chatbot quality, reliability, and regressions.
- Test dynamic and non-deterministic LLM-based systems, designing pragmatic approaches for validating behaviour beyond conventional deterministic test cases.
- Identify, test, and improve guardrails for AI-specific risks, including prompt-injection scenarios and unsafe or unexpected model behaviour.
- Partner with engineers through code reviews, technical discussions, and collaborative debugging to improve quality earlier in the development lifecycle.
- Investigate current testing gaps, research relevant methods and tools, and make evidence-based recommendations to the team.
- Design proof-of-concepts for new testing approaches or tooling, then help productionise the solutions that create the most value.
- Support the evolution of release testing, including clearer quality signals and release-readiness criteria.
- Contribute performance-testing thinking for LLM-powered workflows where relevant.
- Share knowledge, facilitate technical discussions, and build the Quality Chapter across the wider engineering organisation.