Senior Software Engineer (vLLM)

CommonAI CIC is a non-profit membership organisation focused on collaborative engineering for the development of foundational AI technologies. They are seeking a Senior Software Engineer to work on deploying and optimising vLLM and other inference serving engines, contributing to key programmes and enhancing AI innovation.

Responsibilities:

• Deploy, instrument and monitor open weight models served using vLLM
• Implement new features within vLLM to support novel hardware architectures as part of the Scaling Inference Lab
• Work with the Panopticon team to identify opportunities to extend vLLM to enhance accuracy, explainability, and accountability when using it to serve models in regulated environments
• Actively collaborate with the open-source vLLM community to propose, review, and upstream core changes
• Troubleshoot, profile, and optimise inference performance, focusing on latency, throughput, and hardware utilisation