Senior Deep Learning Framework Communications Engineer

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High Performance Computing and Visualization. They are looking for a motivated Deep Learning engineer to bring advanced communication technologies into AI stacks, working with teams to enhance communication libraries and improve performance in AI workloads.

Responsibilities:

• Integrate new communication libraries features in AI frameworks: from PoC to performance analysis to production
• Perform deep analysis of AI workloads and frameworks to identify multi-GPU communication requirements and opportunities. Collaborate hands-on with teams working on the latest AI models
• Improve AI compilers to hide communications or perform automatic fusion
• Conduct in-depth AI workload performance characterization on multi-GPU clusters
• Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads
• Author custom communication or fused compute-communication kernels to showcase ultimate performance on NV platforms
• Influence the roadmap of communication libraries - NCCL & NVSHMEM
• Collaborate with a very dynamic team across multiple time zones