Dell elkezdte szallitani a GB200 NVL72 rack configot - az elso kiszallitott PowerEdge XE9712 a CoreWeave rendelese volt:
Roviden, az NV oldalarol, hogy mi van egyetlen ilyen rackben:
Unlocking Real-Time Trillion-Parameter Models
GB200 NVL72 connects 36 Grace CPUs and 72 Blackwell GPUs in a rack-scale design. The GB200 NVL72 is a liquid-cooled, rack-scale solution that boasts a 72-GPU NVLink domain that acts as a single massive GPU and delivers 30X faster real-time trillion-parameter LLM inference.
The Blackwell Rack-Scale Architecture for Real-Time Trillion-Parameter Inference and Training
The NVIDIA GB200 NVL72 is an exascale computer in a single rack. With 36 GB200s interconnected by the largest NVIDIA® NVLink® domain ever offered, NVLink Switch System provides 130 terabytes per second (TB/s) of low-latency GPU communications for AI and high-performance computing (HPC) workloads.
developer.nvidia.com
Roviden, az NV oldalarol, hogy mi van egyetlen ilyen rackben:
Unlocking Real-Time Trillion-Parameter Models
GB200 NVL72 connects 36 Grace CPUs and 72 Blackwell GPUs in a rack-scale design. The GB200 NVL72 is a liquid-cooled, rack-scale solution that boasts a 72-GPU NVLink domain that acts as a single massive GPU and delivers 30X faster real-time trillion-parameter LLM inference.
The Blackwell Rack-Scale Architecture for Real-Time Trillion-Parameter Inference and Training
The NVIDIA GB200 NVL72 is an exascale computer in a single rack. With 36 GB200s interconnected by the largest NVIDIA® NVLink® domain ever offered, NVLink Switch System provides 130 terabytes per second (TB/s) of low-latency GPU communications for AI and high-performance computing (HPC) workloads.
NVIDIA GB200 NVL72 Delivers Trillion-Parameter LLM Training and Real-Time Inference | NVIDIA Technical Blog
What is the interest in trillion-parameter models? We know many of the use cases today and interest is growing due to the promise of an increased capacity for: The benefits are great…
developer.nvidia.com
