Design Legal Benchmarks for: Contract Drafting, Information Extraction, Legal Research, and Contract Review
Build, source and maintain relevant datasets
Audit AI Output: Review and score complex AI-generated legal text, contract analyses, and statutory interpretations for accuracy and precision and lay out a strategy.
Define Evaluation Metrics: Establish clear criteria for grading model performance, specifically focusing on logical reasoning, citation accuracy, and the model's ability to safely abstain from answering.
Collaborate with Engineering: Partner directly with Engineering to translate legal errors into actionable technical feedback for model fine-tuning.

PhD or Masters in statistics, mathematics, machine learning or equivalent
Analytical Skills: Proven ability to break down complex statutory frameworks and case law into structured, logical data points.
Tech-Savviness: python, panda, numpy, jupiter notebooks and similar statistical models

Head of Evaluations – Legal AI Benchmarking

Key skills