Senior Inference Engineer

vCluster Labs is a venture-backed technology startup pioneering Kubernetes virtualization and GPU infrastructure for the AI era. The Senior Inference Engineer will own the inference platform from the ground up, deploying and serving LLMs at scale, optimizing performance and cost, building production infrastructure in Python or Golang, and shaping the inference roadmap with the CTO and Product team.

Responsibilities:

• Deploying models to production: Take LLMs and put them into production across one or more machines on GPU infrastructure, owning the full pipeline from a customer's query to the served response
• Serving frameworks: Stand up and operate serving infrastructure using vLLM, SGLang, or TensorRT-LLM
• Optimizing for scale: Apply quantization, batching, caching, and routing to keep latency and cost in check as traffic grows
• Programming, not just configuring: Build real infrastructure in Python or Golang — this is an engineering role, not a research or data-science one
• Owning the roadmap: Build the first iteration alongside our CTO, then take the lead on the inference platform and partner with Product to decide what we build next