Applied AI Engineer — Conversational Agents (Senior/Staff)

Revin builds AI-powered software for home-services businesses and is hiring an Applied AI Engineer for its Agents Platform. The role improves conversational agents through analysis of production interactions, experimentation, evaluation, and implementation of reliable production changes, with a substantial focus on voice.

Responsibilities:

• Find the problems worth solving. Analyze production conversations, listen to calls, inspect traces, and work with customer-facing teams to identify failure patterns and prioritize improvements
• Build measurement you can trust. Define quality dimensions and representative evaluation datasets. Combine human judgment, automated graders, and production metrics, and validate that they measure what customers actually experience
• Develop and test hypotheses. Design reproducible experiments, compare approaches, and use offline evaluations and controlled production rollouts to understand what works, where it works, and what tradeoffs it introduces
• Improve the voice experience. Investigate turn-taking, interruptions, response latency, transcription errors, speech quality, and spoken naturalness. Use audio and system telemetry together to diagnose causes and validate changes
• Ship improvements into the agent system. Implement changes, monitor their effects in production, and take responsibility for reliability, cost, and regressions alongside quality gains
• Make improvement repeatable. Turn production failures and experimental findings into reusable datasets, evaluations, debugging tools, and release checks that help the team move faster
• At Staff level, you’ll also shape our evaluation and experimentation strategy across agent capabilities, identify the highest-impact opportunities, and raise the broader team’s ability to diagnose and improve agent behavior while remaining hands-on