Member of Technical Staff, Inference

Inferact is on a mission to grow vLLM as the world's AI inference engine and accelerate AI progress. They are seeking an inference runtime engineer to innovate on the inference engine for large language models and diffusion models, optimizing execution across various hardware.

Responsibilities:

• Push the boundaries of what's possible in LLM and diffusion model serving
• Optimize how models execute across diverse hardware and architectures
• Impact how the world runs AI inference