Machine Learning Research Engineer, Model Evaluation

Convective is a company focused on enhancing weather forecasts through innovative technology, specifically utilizing a network of smart weather balloons. They are seeking a Machine Learning Research Engineer to evaluate AI weather models, ensuring the accuracy and reliability of forecasts by developing evaluation strategies and improving existing infrastructure.

Responsibilities:

• Evaluation strategy — Work with our Meteorology team to develop a rigorous, meteorologically valid strategy for comparing WeatherMesh with leading AI and physics-based models. Choose the metrics, datasets, baselines, and case studies that provide an honest picture of forecast quality
• Fast feedback and durable systems — Build quick evaluations that give researchers useful signals, then turn recurring analyses into reliable, reusable infrastructure. Think systematically about reproducibility, provenance, and how evaluation tools fit into the broader research workflow
• Agentic tooling for evals — Improve our existing evaluation infrastructure, including agentic AI-based tools for investigating forecasts and synthesizing results
• Technical communication — Produce clear scorecards, visualizations, and explanations for researchers, leadership, customers, and external partners. Communicate model performance precisely, including uncertainty and important caveats