Commercial Disputes Subject Matter Expert – AI Evaluation Specialist, On-Call

Role Overview

• Create and review finance, audit, insurance, compliance, and legal-related prompts, scenarios, and analytical tasks.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, and business relevance.
• Apply your professional expertise to improve AI model performance.
• Review analyses, assumptions, calculations, documentation, and recommendations.
• Identify inaccuracies, inconsistencies, logical gaps, and opportunities for improvement.
• Provide structured written feedback and quality assessments.
• Collaborate with project teams to maintain high-quality deliverables.
• Meet established productivity, quality, and turnaround expectations.

Requirements

• Bachelor's degree in Finance, Accounting, Economics, Business, Mathematics, Statistics, Law, Insurance, Risk Management, or a related field.
• Minimum 4 years of professional experience within one or more of the listed finance, audit, insurance, compliance, legal, or risk disciplines.
• Strong analytical and critical-thinking skills.
• Excellent written English communication skills.
• Ability to evaluate complex business, financial, audit, compliance, insurance, or legal concepts and clearly explain your reasoning.
• Reliable internet connection.
• Ability to work independently in a remote environment.