Define and maintain the capability roadmap for FR rating operations, including tools, workflows, reporting structures, and performance measurement systems that support high-quality scoring at scale.
Translate operational needs and scoring insights into clearly defined business requirements, system enhancements, reporting frameworks, and process improvements.
Partner with Technology and Product teams to design, test, and implement enhancements to scoring platforms and data pipelines.
Develop scalable frameworks for evaluating scoring effectiveness, including consistency, accuracy, throughput, and reader-level performance metrics.
Support the end-to-end AP Exam scoring workflow, including reader training, scoring operations, psychometric data collection, and operational reporting.
Monitor scoring performance signals during live AP Reading and enable rapid operational interventions through data-driven insights.
Develop analytic models, dashboards, and reporting tools that provide real-time and post-Reading insights into scoring performance.
Establish standardized reporting and postmortem analysis processes that support continuous improvement across Reading cycles.
Create and maintain cross-functional RACI documentation related to digital scoring platform deployment, configuration, and operational support.

Expertise in operational analytics, scoring operations, education systems, or related fields with experience supporting large-scale operational environments.
Strong analytical and systems-thinking skills, with demonstrated ability to translate data into operational improvements and scalable solutions.
Experience working with large-scale datasets and reporting tools such as Excel, SQL, BI tools, or similar technologies.
Strong project management and prioritization skills with the ability to manage competing priorities across multiple stakeholders.
Excellent written and verbal communication skills, including the ability to simplify complex analyses into actionable insights.
Experience collaborating across cross-functional teams including operations, technology, product, analytics, and research partners.
Comfort operating in both strategic planning and hands-on execution environments.
Experience in assessment, scoring operations, educational measurement, or education data systems strongly preferred.
Bachelor’s degree required; advanced degree preferred.
Ability to travel 2–4 times per year to College Board offices or on behalf of College Board business.

Director, Free Response Rating Capability Analyst

Key skills