AI supercomputers
Colossus, Eos, Isambard-AI, JUPITER, AIRAWAT and the machines that train frontier models. 101 providers on EveryNeocloud so far.
An AI supercomputer is a single very large machine, or one cluster on one network, built to train big models or to run science at scale. Some belong to companies, such as xAI's Colossus, Meta's research clusters and Microsoft's Fairwater sites. Others are national machines, such as JUPITER in Germany, Isambard-AI in the UK, Alps in Switzerland, Fugaku in Japan and AIRAWAT in India.
How they are measured
The TOP500 list, published every June and November since 1993, ranks machines by the HPL benchmark, which measures 64-bit maths used in science. AI training uses lower precision, 16, 8 or even 4 bits, so AI figures in exaflops are far larger than TOP500 scores. Many private AI clusters, including Colossus, do not submit to the list at all, so the largest machines are often known only from company statements.
Public and private
National machines are bought by governments and research bodies and shared among scientists by application. Company clusters are built for one owner's models and are often far larger: by 2025 private training clusters held hundreds of thousands of GPUs, while the largest public machines held tens of thousands. Governments have responded by opening their machines to AI start-ups, as in the EU's AI Factories and the UK's AI Research Resource.
Famous supercomputer providers
Still to be written: Jupiter (supercomputer), AI Bridging Cloud Infrastructure.
Further reading
🇯🇵 JapanFugaku
A Japanese CPU-based supercomputer built by Fujitsu for RIKEN research work.Supercomputer · Other and custom chips · 2020
🇺🇸 United StatesSequoia
IBM Blue Gene/Q supercomputer built for US nuclear weapons simulation at LivermoreSupercomputer · Other and custom chips · 2011
🇨🇭 SwitzerlandSwiss National Supercomputing Centre
Switzerland's national high-performance computing centre, run by ETH Zurich in Lugano.Supercomputer · 1992
🇮🇳 IndiaKabru
A Linux cluster of Pentium Xeon nodes built at IMSc in Chennai for physics simulationsSupercomputer · Other Nvidia GPUs
🇨🇭 SwitzerlandPiz Daint
Swiss national supercomputer at CSCS, upgraded to Cray XC50/XC40 with Tesla P100 GPUsSupercomputer · Nvidia Ampere · 2012
🇨🇳 ChinaNebulae
A petascale supercomputer in Shenzhen built by SugonSupercomputer · Other Nvidia GPUs · 2010
🇧🇷 BrazilSantos Dumont
Brazilian public supercomputer run by LNCC in PetrópolisSupercomputer · 2024
🇵🇹 PortugalDeucalion
Portugal's fastest supercomputer, hosted at MACC in GuimarãesSupercomputer · Nvidia Ampere · 2023
🇯🇵 JapanDEGIMA
GPU cluster at Nagasaki University for astrophysical N-body simulationsSupercomputer · Nvidia Ampere
🇸🇪 SwedenNational Supercomputer Centre in Sweden
Swedish national supercomputer centre in Linköping, running Triolith.Supercomputer
🇬🇧 United KingdomDiRAC
UK supercomputing service for particle physics, astronomy and cosmology researchSupercomputer · 2009
🇷🇺 RussiaChristofari
Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer · Other Nvidia GPUs · 2019
🇹🇼 TaiwanTaipei-1
Nvidia-owned supercomputer in Taiwan's Kaohsiung Software ParkSupercomputer · 2024
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- JUWELS: Forschungszentrum Jülich, CC BY-SA 4.0, source
- MareNostrum: Martidaniel, CC BY-SA 4.0, source
- Barcelona Supercomputing Center: Herodotptlomeu, CC BY-SA 4.0, source
- CINECA: Carlo Dani, CC BY-SA 4.0, source
- Swiss National Supercomputing Centre: CSCS, CC BY-SA 3.0, source
- National Supercomputer Center in Guangzhou: O01326, CC BY-SA 4.0, source
- Earth Simulator: Manatee_tw, CC BY-SA 4.0, source
- Blue Waters: HorsePunchKid, CC BY-SA 3.0, source
- Forschungszentrum Jülich: Bodoklecksel, CC BY-SA 3.0, source
- Alps: Marco Abram, CSCS, CC BY-SA 3.0, source
- Tesla Dojo: Steve Jurvetson, CC BY 2.0, source
- Gyoukou: Kestrel, CC BY-SA 4.0, source
- National Supercomputing Center of Tianjin: Amazingloong, CC BY-SA 4.0, source
- Galileo: CINECA, CC BY 2.0, source
- Spanish Supercomputing Network: David Abián, CC BY-SA 4.0, source
- Aurora: Argonne National Laboratory, Public domain, source
- National Center for Supercomputing Applications: en:User:Ragib / Site , User:Ragib, CC BY 2.5, source
- Texas Advanced Computing Center: UNM Research Data Services, CC BY-SA 2.0, source
- CESGA: Johnander, CC BY-SA 4.0, source
- National Computational Infrastructure: Nick-D, CC BY-SA 3.0, source
- K computer: 0-0t, CC BY-SA 3.0, source
- Tsubame: Kestrel, CC BY-SA 4.0, source
- Sierra: U.S. Department of Energy, Public domain, source
- NERSC: U.S. Department of Energy, Public domain, source
- Sequoia: Lawrence Livermore National Laboratory, Public domain, source
- GENCI: Rambiera, CC BY-SA 4.0, source
- LUMI: Europäische Kommission - Audiovisueller Dienst, Alessandro Rampazzo, C, CC BY 4.0, source
- Fugaku: 文部科学省, CC BY 4.0, source
- High Performance Computing Center, Stuttgart: Julian Herzog ( Website ), CC BY 4.0, source
- Leonardo: Quirinale, Attribution, source
