Senior Deep Learning Frameworks CUDA Software Engineer

NVIDIA is a technology company advancing artificial intelligence, high-performance computing, and visualization through GPU technologies. NVIDIA is seeking a Senior Deep Learning Frameworks CUDA Software Engineer to integrate CUDA features and distributed runtime technologies into AI frameworks, optimize large-scale multi-GPU workloads, and develop performant, fault-tolerant runtime systems and tools.

Responsibilities:

• Integrate new CUDA features and Runtime abstractions in AI frameworks: from PoC to performance analysis to production
• Perform deep analysis of AI workloads and frameworks to identify requirements and opportunities to innovate in the lower layers of the stack. Collaborate hands-on with teams working on the latest AI models
• Own and drive improvements in the AI Compiler-Runtime interface to build speed-of-light multi-GPU multi-node solutions
• Design fault-tolerant and elastic solutions for large-scale or dynamic AI workloads
• Influence the roadmap of core CUDA to facilitate building next-gen DL frameworks
• Collaborate with a very dynamic team across multiple time zones
• Collaborate closely with AI researchers, HW and SW architects, kernel and compiler authors and CUDA driver experts to co-design systems and frameworks that enhance performance and programmability
• Develop exploratory tools and runtime systems to profile and accelerate new paradigms in deep learning
• Write clean, effective, and maintainable code, ensuring exploratory prototypes can smoothly transition into open-source releases, upstream framework integrations, internal tools, or closed-source commercial products