Manual QA Engineer

Alivo is transforming how businesses connect with their customers using cutting-edge AI technology. They are seeking a detail-oriented Manual QA Engineer to own manual testing, validate releases, and evaluate AI conversation quality across their platform.

Responsibilities:

• Own Manual Product Testing
• Manually test new features, workflows, and user experiences before release
• Perform exploratory testing to identify bugs, usability issues, and edge cases
• Validate functionality across staging and production-like environments
• Execute structured test plans and release checklists to ensure consistent quality
• Verify bug fixes and regression testing across product releases
• Drive Product Quality & Release Readiness
• Review feature implementations and release candidates before deployment
• Partner with Engineering to identify risks and improve release confidence
• File clear, reproducible bug reports with detailed documentation
• Help establish and improve manual testing processes as the company grows
• Serve as a trusted quality gate for production releases
• Own AI Conversation Quality‍
• Evaluate AI-powered phone and chat conversations for quality and effectiveness
• Assess whether conversations are natural, accurate, helpful, and aligned with customer goals
• Review objection handling, conversational flow, and customer experience outcomes
• Identify failure modes, edge cases, hallucinations, and off-script behavior
• Help define quality standards and acceptance criteria for AI-powered interactions
• Build AI Evaluation Processes‍
• Develop and maintain conversation evaluation datasets and testing scenarios
• Create scoring rubrics and quality frameworks for measuring AI performance
• Track AI quality over time and identify regressions or performance changes
• Provide actionable recommendations that improve prompts, workflows, and AI behavior
• Collaborate Cross-Functionally
• Work closely with Engineering, Product, Customer Success, and Leadership
• Provide feedback that improves both product quality and customer outcomes
• Help prioritize quality improvements based on customer impact and business goals
• Support a culture of quality throughout the organization