AI supercomputers
Colossus, Eos, Isambard-AI, JUPITER, AIRAWAT and the machines that train frontier models. 101 providers on EveryNeocloud so far.
An AI supercomputer is a single very large machine, or one cluster on one network, built to train big models or to run science at scale. Some belong to companies, such as xAI's Colossus, Meta's research clusters and Microsoft's Fairwater sites. Others are national machines, such as JUPITER in Germany, Isambard-AI in the UK, Alps in Switzerland, Fugaku in Japan and AIRAWAT in India.
How they are measured
The TOP500 list, published every June and November since 1993, ranks machines by the HPL benchmark, which measures 64-bit maths used in science. AI training uses lower precision, 16, 8 or even 4 bits, so AI figures in exaflops are far larger than TOP500 scores. Many private AI clusters, including Colossus, do not submit to the list at all, so the largest machines are often known only from company statements.
Public and private
National machines are bought by governments and research bodies and shared among scientists by application. Company clusters are built for one owner's models and are often far larger: by 2025 private training clusters held hundreds of thousands of GPUs, while the largest public machines held tens of thousands. Governments have responded by opening their machines to AI start-ups, as in the EU's AI Factories and the UK's AI Research Resource.
Famous supercomputer providers
Still to be written: Jupiter (supercomputer), AI Bridging Cloud Infrastructure.
Further reading
🇺🇸 United StatesSequoia
IBM Blue Gene/Q supercomputer built for US nuclear weapons simulation at LivermoreSupercomputer · Other and custom chips · 2011
🇺🇸 United StatesPittsburgh Supercomputing Center
Joint Carnegie Mellon and Pittsburgh university centre for research computing and networkingResearch cluster · Other Nvidia GPUs · 1986
🇺🇸 United StatesNCAR-Wyoming Supercomputing Center
A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer · Other Nvidia GPUs · 2003
🇲🇾 Malaysia and 4 moreYTL AI Cloud
Malaysian AI cloud and supercomputer run from a solar-backed Johor data centre parkNeocloud · Nvidia Blackwell · 2024
🇨🇭 SwitzerlandSwiss National Supercomputing Centre
Switzerland's national high-performance computing centre, run by ETH Zurich in Lugano.Supercomputer · 1992
🇺🇸 United StatesSelene
Nvidia's own DGX SuperPOD supercomputer, built in three months in 2020Supercomputer · Nvidia Ampere · 2020
🇨🇭 SwitzerlandAlps
Swiss national supercomputer using Nvidia GH200 chips for AI and scientific research.Supercomputer · Other Nvidia GPUs · 2024
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Frontier: OLCF at ORNL, CC BY 2.0, source
- CoreWeave: Wikideas1, CC0, source
- Cerebras: Coolcaesar, CC BY 4.0, source
- Summit: Carlos Jones/ORNL, CC BY 2.0, source
- JUWELS: Forschungszentrum Jülich, CC BY-SA 4.0, source
- NCAR-Wyoming Supercomputing Center: National Science Foundation, Public domain, source
- MareNostrum: Martidaniel, CC BY-SA 4.0, source
- Barcelona Supercomputing Center: Herodotptlomeu, CC BY-SA 4.0, source
- CINECA: Carlo Dani, CC BY-SA 4.0, source
- Swiss National Supercomputing Centre: CSCS, CC BY-SA 3.0, source
- SoftBank Group: Akonnchiroll, CC BY-SA 4.0, source
- NextDC: Samuel Wiki, CC0, source
- Forschungszentrum Jülich: Bodoklecksel, CC BY-SA 3.0, source
- Alps: Marco Abram, CSCS, CC BY-SA 3.0, source
- Tesla Dojo: Steve Jurvetson, CC BY 2.0, source
- Galileo: CINECA, CC BY 2.0, source
- Spanish Supercomputing Network: David Abián, CC BY-SA 4.0, source
- Aurora: Argonne National Laboratory, Public domain, source
- Texas Advanced Computing Center: UNM Research Data Services, CC BY-SA 2.0, source
- National Computational Infrastructure: Nick-D, CC BY-SA 3.0, source
- Titan: OLCF at ORNL, CC BY 2.0, source
- K computer: 0-0t, CC BY-SA 3.0, source
- YTL AI Cloud: YTL Power International Berhad, CC BY-SA 4.0, source
- Tsubame: Kestrel, CC BY-SA 4.0, source
- Sierra: U.S. Department of Energy, Public domain, source
- NERSC: U.S. Department of Energy, Public domain, source
- Sequoia: Lawrence Livermore National Laboratory, Public domain, source
- LUMI: Europäische Kommission - Audiovisueller Dienst, Alessandro Rampazzo, C, CC BY 4.0, source
- Fugaku: 文部科学省, CC BY 4.0, source
- Leonardo: Quirinale, Attribution, source
