Member of Technical Staff, Model Evaluation

Inception is a company focused on creating the world’s fastest and most efficient AI models. They are seeking experienced engineers and scientists to develop evaluation metrics and systems that drive frontier LLM performance, ensuring models perform reliably at scale in production.

Responsibilities:

• Design, develop, and maintain robust evaluation frameworks and benchmarks for measuring LLM performance across diverse tasks and domains
• Define and implement quantitative metrics that capture model quality, safety, reliability, and regression detection
• Build scalable, automated evaluation pipelines that integrate into model training and deployment workflows
• Conduct rigorous statistical analysis of model outputs to identify failure modes, biases, and performance gaps
• Partner with product and customer-facing teams to translate real-world use cases into meaningful evaluation criteria