Key skills

AI Infrastructure Software EngineeringLarge-Scale Distributed SystemsAI Training and Inference InfrastructureDebugging and Root Cause AnalysisPythonC/C++Observability and Telemetry ELKObservability and Telemetry PrometheusObservability and Telemetry LokiSoftware TestingDefensive ProgrammingVersion Control and Continuous IntegrationRDMA Software Stack NCCLRDMA Software Stack IB VerbsRDMA Software Stack UCXRDMA Software Stack libfabricLarge-Scale AI ClustersAIArtificial Intelligence

About this role

NVIDIA develops technologies in Artificial Intelligence, High-Performance Computing, and Visualization. The Senior DGX Cloud AI Infrastructure Software Engineer will design, build, and maintain infrastructure software for large-scale AI training and inference, while improving system efficiency, resiliency, availability, and reliability.

Responsibilities:

Develop infrastructure software and tools for large-scale pre-training, post-training, and inference
Develop and optimize tools and libraries to improve infrastructure efficiency and resiliency
Co-design and implement APIs for integration with NVIDIA's resiliency stacks
Enhance infrastructure and products underpinning NVIDIA's AI platforms
Define meaningful and actionable reliability metrics to track and improve system and service reliability
Skilled in problem-solving, root cause analysis, and optimization
Root cause and analyze and triage failures from the application level to the hardware level