Senior Deep Learning Software Engineer, Inference

NVIDIA is at the forefront of breakthroughs in Artificial Intelligence, High-Performance Computing, and Visualization. They are seeking a Senior Software Engineer specializing in Deep Learning Inference to design, build, and optimize GPU-accelerated software for AI applications.

Responsibilities:

• Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI
• Scale performance of DL models across different architectures and types of NVIDIA accelerators
• Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions
• Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions