NVIDIA GB200 NVL72 GPU Infrastructure & Deployment_
GB200 NVL72 combines 72 Blackwell GPUs and 36 Grace CPUs in a rack-scale NVLink domain. Liquid-cooled compute and high-density cabling require an approved OEM/site installation plan.
What Is the NVIDIA GB200?_
The NVIDIA GB200 NVL72 is a Blackwell rack-scale system with 72 GPUs, 36 Grace CPUs and fifth-generation NVLink. NVIDIA lists 13.4 TB of aggregate GPU memory. Its DGX reference rack uses 18 compute trays, each with four GPUs and two CPUs; exact OEM configurations must be checked against the supplied documentation.
NVIDIA describes roughly 120 kW consumption for the DGX GB reference rack. CPUs and GPUs use liquid cold plates, while other components still depend on airflow. Qualified facility/OEM teams must approve power, cooling and placement requirements; Leviathan can scope physical assembly, cabling and handoff without offering any liquid-side work.
Technical Specifications_
| Specification | GB200 NVL72 |
|---|---|
| Architecture | Blackwell |
| GPU Memory | 13.4 TB HBM3e per NVL72 rack (NVIDIA published specification) |
| GPUs per Rack | 72 (NVL72 configuration) |
| TDP per Rack | Approximately 120 kW in NVIDIA DGX GB reference; verify OEM input |
| Rack Weight | Exact OEM populated/shipping weight required |
| Interconnect | NVLink 5.0, InfiniBand NDR |
| Networking | 400G ConnectX-7 in DGX GB200 reference; OEM BOM governs |
| Cooling | Liquid-cooled compute; ancillary airflow still required |
Deployment Considerations_
Use the exact OEM electrical specification and approved facility design for rack input, upstream capacity and protection. Hardwiring, busway taps, new circuits and energization are outside Leviathan scope. Existing-equipment/rack-PDU cord work requires separate OEM/site/personnel/insurance agreement.
The DGX GB200 reference uses ConnectX-7 400G adapters for scale-out networking. Agree the actual switch/adapter BOM, compatible connector and cable reach, polarity, port map and pathways before installation; NVLink scale-up and external fabric cabling are distinct systems.
NVL72 compute requires its OEM liquid-cooling system and approved site interface. The customer-appointed mechanical/OEM specialists own CDU work, manifolds, fluid connections, leak/pressure tests and loop commissioning. Leviathan provides no liquid-side service.
Related Resources
Discuss Your Infrastructure Project_
Tell us about your project, and our team will follow up to discuss the scope, requirements and availability.
Discuss a ProjectEmail Project Scope