Crossing Hurdles is seeking a Simulated Research Reviewer to evaluate simulated research environments. The role involves reviewing model trajectories, providing technical feedback, and improving research systems through expert evaluation.
Responsibilities:
- Review simulated research environments built around scientific simulators and datasets
- Evaluate multiple model trajectories generated from different prompts against the same research seed
- Provide structured technical feedback on scientific reasoning, problem quality, and environment design
- Help improve next-generation research systems through expert domain evaluation
- Review input datasets and multiple model trajectories, assessing reasoning quality, methodology, and conclusions
- Summarize trajectory outcomes, scientific approaches, and decision-making processes in a structured format
- Evaluate problem realism, scientific rigor, solvability, experiment design, scoring metrics, and overall environment quality
- Assess prompt diversity and recommend stronger or more natural task formulations using the same simulator foundation
- Apply expertise in mechanical engineering, materials science, computational simulation, experimental design, or scientific computing
- Deliver clear, concise, and technically rigorous written feedback across complex scientific topics
Requirements:
- Review input datasets and multiple model trajectories, assessing reasoning quality, methodology, and conclusions
- Summarize trajectory outcomes, scientific approaches, and decision-making processes in a structured format
- Evaluate problem realism, scientific rigor, solvability, experiment design, scoring metrics, and overall environment quality
- Assess prompt diversity and recommend stronger or more natural task formulations using the same simulator foundation
- Apply expertise in mechanical engineering, materials science, computational simulation, experimental design, or scientific computing
- Deliver clear, concise, and technically rigorous written feedback across complex scientific topics
- Hold a Master s or PhD in Mechanical Engineering, Materials Science, or a closely related discipline