AI Engineer

Zoom is hiring an AI Engineer to build and optimize production inference systems for its AI models. The role focuses on improving model-serving performance, extending inference frameworks, and partnering with research and platform teams to deploy new architectures.

Responsibilities:

• Build, tune and maintain components of Zoom's inference serving stack for transformer and multimodal models, including large and Mixture-of-Experts (MoE) architectures
• Implement and evaluate inference optimisations such as speculative decoding, continuous batching, KV cache management, parallelism layouts and quantisation (INT4/INT8/FP8)
• Extend and customise inference frameworks (vLLM, SGLang, TensorRT-LLM or equivalent) to support new models and Zoom's production requirements
• Profile GPU workloads with Nsight Systems or equivalent tools, root-cause performance regressions, and validate improvements with reproducible benchmarks
• Build and improve internal tooling for benchmarking, performance modelling and serving configuration
• Partner with researchers to bring new model architectures into production efficiently
• Contribute to on-call and production support for the services you build, with guidance from senior engineers