GPU
A chip with thousands of small cores working in parallel, first built for graphics and now the main engine of AI.
Also: graphics processing unit
A graphics processing unit was designed to draw images by doing the same simple sum on many pixels at once. That same parallel design suits the matrix arithmetic at the heart of neural networks, and since around 2012 GPUs have been the main hardware for training and running AI models. A modern data centre GPU, such as an Nvidia H100 or B200 or an AMD MI300X, has tens of thousands of arithmetic units, specialised tensor cores and very fast stacked memory, and draws about 700 to 1,400 watts. Providers usually count their size in GPUs.