Nvidia launches GB200 NVL72 system to boost AI performance with advanced NVLink technology
Nvidia has introduced the GB200 NVL72 system, featuring 18 NVLink Switches that connect 36 Grace CPUs and 72 Blackwell GPUs. This setup offers a total communications bandwidth of 130 terabytes per second, significantly enhancing data center performance. The new NVLink Switch technology allows for faster, non-blocking communication, improving efficiency in AI and high-performance computing workloads. It supports larger model sizes, exceeding current generative AI models, and can scale up to 576 GPUs. While existing data centers may face challenges in adopting this technology due to power and cooling needs, the GB200 NVL72 enables more efficient use of space and resources, paving the way for future AI advancements.