Research Scientist, Benchmarks & Evals

Kled is building benchmarks and evaluations to demonstrate the value of its opt-in human data network for frontier AI models. The Research Scientist will develop benchmarks, test sets, experiments, and evaluation methods, publish trusted results, and use findings to guide data collection and support data deals.

Responsibilities:

• Design and ship public benchmarks for image, video and document models
• Build private test sets from real, opt-in data that no model has trained on
• Run data-value experiments: train models with and without Kled data, measure what changes
• Design human evaluation studies and the automatic metrics that track them
• Publish leaderboards and reports that researchers at frontier labs trust
• Find where models fall short and tell our team what data to collect next
• Work directly with the founders and lab buyers to turn results into data deals