Hardware-Aware Model Optimisation - Member of Technical Staff

Callosum is hiring a Hardware-Aware Model Optimisation Member of Technical Staff to adapt model architectures and inference algorithms to heterogeneous hardware. The role develops automated hardware-specialised model variants and evaluation methods to assess their quality, latency, and cost trade-offs.

Responsibilities:

• Develop hardware-aware transformations that adapt models to different accelerator architectures and execution environments
• Explore numerical, structural, and memory-related optimisations to create model variants with different capability, latency, and cost trade-offs
• Investigate new inference algorithms, including speculative decoding, designed to exploit heterogeneous computational resources
• Develop automated methods for discovering, characterising, and optimising hardware-specialised model variants
• Build evaluation methods that measure model quality and establish the trade-offs introduced by hardware-aware adaptations