David Joseph & Company is partnering with AfterQuery, a company focused on building training data infrastructure for frontier AI labs. They are seeking a hands-on Research Scientist to design experiments that improve AI systems, focusing on model behavior, data quality, and evaluation design.
Responsibilities:
- Designing high-signal datasets and identifying model failure modes
- Data slicing strategy, benchmark design, and evaluation framework construction
- Reward signal design, RLHF pipeline support, and RLVR experimentation
- Annotator behavior modeling and dataset diversity measurement
- Alignment capability measurement and quantitative experimentation
- Translating frontier lab training objectives into concrete datasets
- Fast experiment iteration under ambiguity across domains including finance, software engineering, enterprise workflows, and policy-related reasoning