AI Inference Engineer

Premier Global Links LLC is seeking an experienced Member of Technical Staff, Inference Systems, to build and optimize a high-performance AI inference platform. The role focuses on LLM inference, model serving, distributed systems, inference runtime performance, and production systems engineering, including collaboration on core platform architecture and technical decisions.

Responsibilities:

• Build and optimize production LLM inference and model-serving systems
• Develop inference runtime components using Rust and other systems-level technologies
• Design and implement batching, scheduling, request routing, and serving infrastructure
• Build and optimize KV cache and prefix caching systems
• Scale inference workloads across multi-GPU and multi-node environments
• Profile, benchmark, and optimize latency, throughput, reliability, and cost
• Work with inference engines such as vLLM, SGLang, or TensorRT-LLM
• Investigate performance bottlenecks across the inference stack
• Contribute to core architecture and technical decisions for the platform
• Collaborate with a small, hands-on engineering team in a fast-paced environment