HumanSignal is a human data partner for companies building AI models and products. They are seeking a Graphic Design Expert to evaluate and rate graphic design elements to train AI models that assess design effectiveness, contributing to the advancement of AI's understanding of visual content quality.
Responsibilities:
- Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions:
- Typography quality (readability, hierarchy, font pairing appropriateness)
- Visual hierarchy effectiveness (clarity, balance, focal point strength)
- Design element execution (icon quality, illustration polish, image selection)
- Color palette effectiveness (harmony, contrast, accessibility)
- Layout and composition quality (grid usage, spacing, alignment)
- Overall design effectiveness and professional polish
- Apply consistent 1-5 rating scales across hundreds of design examples
- Provide clear, objective assessments based on established design principles
- Follow detailed rating guidelines and rubrics to maintain consistency
- Process high volumes of design samples with sustained attention to detail
- Participate in weekly calibration sessions to align rating standards
- Meet quality benchmarks for rating consistency and inter-rater reliability