NVSwitch
A switch chip that connects many GPUs over NVLink so that every GPU can talk to every other at full speed.
NVSwitch is Nvidia's switch for NVLink traffic. Instead of wiring each GPU to every other directly, all GPUs connect to NVSwitch chips, which route data between them at full NVLink speed. In an eight-GPU server the switches sit on the baseboard; in a GB200 NVL72 rack, 18 NVSwitch chips in nine switch trays join all 72 GPUs. This is what makes a rack behave like one large GPU for the most demanding parts of training and inference.