AI supercomputers
Colossus, Eos, Isambard-AI, JUPITER, AIRAWAT and the machines that train frontier models. 101 providers on EveryNeocloud so far.
An AI supercomputer is a single very large machine, or one cluster on one network, built to train big models or to run science at scale. Some belong to companies, such as xAI's Colossus, Meta's research clusters and Microsoft's Fairwater sites. Others are national machines, such as JUPITER in Germany, Isambard-AI in the UK, Alps in Switzerland, Fugaku in Japan and AIRAWAT in India.
How they are measured
The TOP500 list, published every June and November since 1993, ranks machines by the HPL benchmark, which measures 64-bit maths used in science. AI training uses lower precision, 16, 8 or even 4 bits, so AI figures in exaflops are far larger than TOP500 scores. Many private AI clusters, including Colossus, do not submit to the list at all, so the largest machines are often known only from company statements.
Public and private
National machines are bought by governments and research bodies and shared among scientists by application. Company clusters are built for one owner's models and are often far larger: by 2025 private training clusters held hundreds of thousands of GPUs, while the largest public machines held tens of thousands. Governments have responded by opening their machines to AI start-ups, as in the EU's AI Factories and the UK's AI Research Resource.
Famous supercomputer providers
Still to be written: Jupiter (supercomputer), AI Bridging Cloud Infrastructure.
Further reading
🇺🇸 United StatesNCAR-Wyoming Supercomputing Center
A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer · Other Nvidia GPUs · 2003
🇨🇭 SwitzerlandAlps
Swiss national supercomputer using Nvidia GH200 chips for AI and scientific research.Supercomputer · Other Nvidia GPUs · 2024
🇮🇹 ItalyHPC5
Eni's Dell-built GPU supercomputer in northern ItalySupercomputer · Other Nvidia GPUs · 2020
🇨🇭 SwitzerlandPiz Daint
Swiss national supercomputer at CSCS, upgraded to Cray XC50/XC40 with Tesla P100 GPUsSupercomputer · Nvidia Ampere · 2012
🇨🇳 ChinaNebulae
A petascale supercomputer in Shenzhen built by SugonSupercomputer · Other Nvidia GPUs · 2010
🇯🇵 JapanDEGIMA
GPU cluster at Nagasaki University for astrophysical N-body simulationsSupercomputer · Nvidia Ampere
🇷🇺 RussiaChristofari
Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer · Other Nvidia GPUs · 2019
🇨🇳 ChinaTianhe-1
Chinese petascale supercomputer at the National Supercomputing Center in TianjinSupercomputer · Other Nvidia GPUs · 2009
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- CoreWeave: Wikideas1, CC0, source
- Summit: Carlos Jones/ORNL, CC BY 2.0, source
- NCAR-Wyoming Supercomputing Center: National Science Foundation, Public domain, source
- Barcelona Supercomputing Center: Herodotptlomeu, CC BY-SA 4.0, source
- Tianhe-2: O01326, CC BY-SA 4.0, source
- Alps: Marco Abram, CSCS, CC BY-SA 3.0, source
- Tianhe-1: Nakrut, CC BY-SA 4.0, source
- National Supercomputing Center of Tianjin: Amazingloong, CC BY-SA 4.0, source
- Galileo: CINECA, CC BY 2.0, source
- Aurora: Argonne National Laboratory, Public domain, source
- Texas Advanced Computing Center: UNM Research Data Services, CC BY-SA 2.0, source
- National Computational Infrastructure: Nick-D, CC BY-SA 3.0, source
- Titan: OLCF at ORNL, CC BY 2.0, source
- Tsubame: Kestrel, CC BY-SA 4.0, source
- Sierra: U.S. Department of Energy, Public domain, source
- LUMI: Europäische Kommission - Audiovisueller Dienst, Alessandro Rampazzo, C, CC BY 4.0, source
- Fugaku: 文部科学省, CC BY 4.0, source
- Leonardo: Quirinale, Attribution, source
