Netherlands
6 days ago
Senior/Lead Quality Engineer - Chatbot
Mimica
Netherlands
6 days ago
Senior/Lead Quality Engineer - Chatbot
Mimica is seeking a Senior/Lead Quality Engineer to establish quality foundations for a new Chatbot product team. The role involves developing test strategies, evaluating LLM-based systems, and collaborating with software and ML engineers. Fully remote position within UTC-5 to UTC+1 timezones.
Core AIRemoteFull-timeSeniorQuality EngineeringTest Automation
Senior/Lead Quality Engineer - Chatbot
Mimica is seeking a Senior/Lead Quality Engineer to establish quality foundations for a new Chatbot product team. The role involves developing test strategies, evaluating LLM-based systems, and collaborating with software and ML engineers. Fully remote position within UTC-5 to UTC+1 timezones.
Core AIRemoteFull-timeSeniorQuality Engineering
Salary
Not specified
Core Qualifications
Technical (Must-have)
Quality EngineeringTest AutomationSDETProgrammingLLMRAGConversational AIChatbot TestingCode ReviewPerformance TestingAI SecurityPrompt InjectionTest StrategyRelease ProcessesCollaboration
Soft Skills
CommunicationCollaborationProblem SolvingJudgmentPragmatismInvestigative MindsetExperimentation
Preferred Qualifications
Technical (Nice-to-have)
AI Security TestingSafety TestingAgentic WorkflowsMentoringKnowledge Sharing
Key Responsibilities
- Develop and evolve quality practices, test strategy, and release processes for the Chatbot product.
- Help establish and run an output-evaluation framework for assessing Chatbot quality, reliability, and regressions.
- Test dynamic and non-deterministic LLM-based systems, designing pragmatic approaches for validating behaviour beyond conventional deterministic test cases.
- Identify, test, and improve guardrails for AI-specific risks, including prompt-injection scenarios and unsafe or unexpected model behaviour.
- Partner with engineers through code reviews, technical discussions, and collaborative debugging to improve quality earlier in the development lifecycle.
- Investigate current testing gaps, research relevant methods and tools, and make evidence-based recommendations to the team.
- Design proof-of-concepts for new testing approaches or tooling, then help productionise the solutions that create the most value.
- Support the evolution of release testing, including clearer quality signals and release-readiness criteria.
- Contribute performance-testing thinking for LLM-powered workflows where relevant.
- Share knowledge, facilitate technical discussions, and build the Quality Chapter across the wider engineering organisation.
Quality EngineeringChatbotLLMAIRemoteSeniorLeadSoftware DevelopmentQuality AssuranceTest Automation