Meridial Marketplace, by Invisible is sourcing independent Search Engine Evaluation Specialists for an AI benchmark evaluation project. The role involves designing complex evaluation frameworks and generating structured training data to enhance the accuracy of AI models interpreting search intent and ranking responses.
Responsibilities:
- Operate autonomously to design complex evaluation frameworks and provide structured training data
- Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to search rank response analysis, indexing logic, and query relevance
- Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex SEO and search engine ranking tasks
- Ensuring all generated tasks and scoring criteria reflect strict, real-world search quality rating standards, technical indexing mechanics, and user intent accuracy
Requirements:
- Demonstrable professional expertise within the Search Engine Optimization (SEO), search quality rating, or digital marketing sectors, with a deep understanding of indexing, ranking factors, and search response evaluation
- Strong writing and prompt generation skills, with the ability to design highly realistic, complex search evaluation task scenarios for AI training
- Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation
- A meticulous, detail-oriented approach to fact-checking search rankings, evaluating content quality against official rating guidelines, and generating reliable data for system benchmarking