Inference Performance & Deployment - Member of Technical Staff

Callosum is an Intelligent Systems Company building infrastructure that unifies heterogeneous compute across the full stack for application-aware AI systems. The Member of Technical Staff will own inference performance and deployment, running production-equivalent experiments, developing reproducible deployment methods, improving orchestration and routing, and driving system optimisation through empirical benchmarking.

Responsibilities:

• Run experiments self-hosting models on cloud instances or on-prem across providers and hardware configurations, systematically characterising performance envelopes
• Develop and maintain deployment patterns that are reproducible, measurable, and optimised for latency, throughput, and cost
• Work at the orchestration and routing software that sits above the inference engine - to improve caching, request scheduling, batching, and resource allocation
• Act as the integration point for the other roles: consume new accelerator support, engine features, and infrastructure upgrades – to provide high-quality feedback on bottlenecks, essential capabilities, and guide the stack optimisations
• Build and maintain benchmarking harnesses, regression suites, and performance dashboards that give the team a shared view of system health and progress