Research Scientist – Frontier Data — AfterQuery

AfterQuery is a company that builds training data infrastructure and evaluation systems for frontier AI labs. They are seeking a Research Scientist to focus on model behavior, data quality, evaluation design, and RL training systems, with responsibilities including designing datasets and conducting experiments to enhance AI systems.

Responsibilities:

• Designing high-signal datasets and identifying model failure modes
• Data slicing strategy, benchmark design, and evaluation framework construction
• Reward signal design, RLHF pipeline support, and RLVR experimentation
• Annotator behavior modeling and dataset diversity measurement
• Alignment capability measurement and quantitative experimentation
• Translating frontier lab training objectives into concrete datasets
• Fast experiment iteration under ambiguity across domains including finance, software engineering, enterprise workflows, and policy-related reasoning