What Is NVL72?_
NVL72 refers to NVIDIA's rack-scale GPU system containing 72 GPUs and 36 Grace CPUs connected by NVLink in a single liquid-cooled rack. The GB200 NVL72 and GB300 NVL72 are the two current NVL72 platforms, drawing approximately 120 kW each and requiring 100% direct liquid cooling.
Technical Details
The NVL72 architecture represents a fundamental shift from traditional server-based GPU deployment. Instead of discrete servers in a rack, the NVL72 integrates 72 GPUs and 36 Grace CPUs into a unified rack-scale system connected by NVLink 5.0 with 130 TB/s total interconnect bandwidth. NVSwitch chips inside the rack provide all-to-all GPU connectivity without external NVLink cables. The external network connections (400GbE or InfiniBand to leaf/spine switches) are still dense, with 200+ fiber connections per rack. The rack weighs approximately 1,360 kg, requires verified floor loading capacity, and uses mandatory direct liquid cooling with CDUs, manifolds, and quick-disconnect fittings.
How Leviathan Systems Works with NVL72
Leviathan Systems has direct deployment experience with both GB200 NVL72 and GB300 NVL72 systems, including site preparation, rack positioning, liquid cooling integration, network cabling, and commissioning.