Alivo is transforming how businesses connect with their customers using cutting-edge AI technology. They are seeking a detail-oriented Manual QA Engineer to own manual testing, validate releases, and evaluate AI conversation quality across their platform.
Responsibilities:
- Own Manual Product Testing
- Manually test new features, workflows, and user experiences before release
- Perform exploratory testing to identify bugs, usability issues, and edge cases
- Validate functionality across staging and production-like environments
- Execute structured test plans and release checklists to ensure consistent quality
- Verify bug fixes and regression testing across product releases
- Drive Product Quality & Release Readiness
- Review feature implementations and release candidates before deployment
- Partner with Engineering to identify risks and improve release confidence
- File clear, reproducible bug reports with detailed documentation
- Help establish and improve manual testing processes as the company grows
- Serve as a trusted quality gate for production releases
- Own AI Conversation Quality
- Evaluate AI-powered phone and chat conversations for quality and effectiveness
- Assess whether conversations are natural, accurate, helpful, and aligned with customer goals
- Review objection handling, conversational flow, and customer experience outcomes
- Identify failure modes, edge cases, hallucinations, and off-script behavior
- Help define quality standards and acceptance criteria for AI-powered interactions
- Build AI Evaluation Processes
- Develop and maintain conversation evaluation datasets and testing scenarios
- Create scoring rubrics and quality frameworks for measuring AI performance
- Track AI quality over time and identify regressions or performance changes
- Provide actionable recommendations that improve prompts, workflows, and AI behavior
- Collaborate Cross-Functionally
- Work closely with Engineering, Product, Customer Success, and Leadership
- Provide feedback that improves both product quality and customer outcomes
- Help prioritize quality improvements based on customer impact and business goals
- Support a culture of quality throughout the organization