Node
One server in a cluster, in AI usually a box holding eight GPUs, two processors, memory and network cards.
Also: server, GPU server
A node is a single computer within a larger system. In AI clusters the standard node holds eight GPUs on one baseboard, joined to each other by NVLink, plus two server processors, a few terabytes of memory, local flash storage and several high-speed network cards, often one per GPU. Nvidia sells the baseboard design as HGX to server makers and its own complete server as DGX. A node of this kind draws around 10 kW or more. Rack-scale designs such as the NVL72 blur the line, since a whole rack acts as one large node.