Crossing Hurdles is seeking Engineering & Built Environment Experts for a contract position. The role involves authoring complex tasks to evaluate AI's interpretation of engineering documentation and collaborating with team members to improve evaluation methodologies.
Responsibilities:
- Author complex, multi-step tasks that evaluate AI's ability to interpret engineering documentation and follow instructions
- Utilize real-world workspace files such as technical drawings, project specifications, and engineering reports to create evaluation tasks
- Conduct web searches and execute code to support task development and evaluation
- Develop clear ground truth outputs and objective evaluation rubrics for AI performance assessment
- Collaborate with team members to refine task structures and improve evaluation methodologies
Requirements:
- Have strong relevant experience in mechanical engineering, civil engineering, industrial engineering, or architecture
- Demonstrated ability to create and evaluate complex engineering tasks and documentation
- Familiarity with technical documentation and engineering principles is essential
- Experience with AI model evaluation or similar technical assessments