News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Training clusters

Reserved clusters of thousands of GPUs on one fabric. 105 providers on EveryNeocloud so far.

A training cluster is a block of hundreds to hundreds of thousands of GPUs joined on one fast network, reserved by one customer for months or years. This is how frontier models are trained, and it is the core business of the largest neoclouds. Deals are signed as contracts worth billions of dollars, often before the data centre is built.

What makes a cluster

Inside each server, GPUs talk over NVLink; between servers they use InfiniBand or fast Ethernet in a layout called a fat tree, so any GPU can reach any other at full speed. Shared storage feeds training data, and software such as Slurm or Kubernetes schedules jobs and restarts them when a GPU fails, which in a cluster of 100,000 GPUs happens many times a day.

How it is sold

Customers sign take-or-pay contracts: they pay for the capacity whether or not they use it. Microsoft, OpenAI, Meta and Google have signed such deals with CoreWeave, Nebius, Nscale, IREN and others. The contracts let providers borrow against them to buy GPUs. Critics say this ties a small number of buyers and lenders together; providers say long contracts make the business stable.

Famous training clusters providers

Further reading

G42 馃嚘馃嚜 United Arab Emirates and 4 moreG42 Abu Dhabi AI holding group running cloud, data centres and national compute projectsNeocloud 路 Nvidia Blackwell 路 2018 馃嚭馃嚫 United StatesNCAR-Wyoming Supercomputing Center A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer 路 Other Nvidia GPUs 路 2003 Humain 馃嚫馃嚘 Saudi ArabiaHumain Saudi AI company building data centres, cloud services and Arabic modelsNeocloud 路 Other Nvidia GPUs 路 2025 IREN 馃嚘馃嚭 Australia and 2 moreIREN Australian GPU cloud and data centre operator for AI workloadsNeocloud 路 Other Nvidia GPUs 路 2018 Netweb Technologies 馃嚠馃嚦 IndiaNetweb Technologies Indian maker of supercomputers, AI systems and data centre serversSupercomputer 路 1996 馃嚭馃嚫 United States and 4 moreGoogle data centers Hyperscale campuses running Search, YouTube, Gemini and Google Cloud AI workloadsHyperscaler 路 Google TPU PARAM 馃嚠馃嚦 India and 4 morePARAM India's home-grown supercomputer line, built by C-DAC in Pune since the early 1990sSupercomputer 路 Other and custom chips 路 1991 Pawsey Supercomputing Centre 馃嚘馃嚭 AustraliaPawsey Supercomputing Centre National research computing centre in Perth with supercomputers, storage and cloud.Supercomputer 路 2014 馃嚭馃嚫 United States and 2 moreAmazon Web Services Amazon's on-demand cloud platform, offering compute, storage and AI infrastructure worldwideHyperscaler 路 Other Nvidia GPUs 路 2006 Gcore 馃嚤馃嚭 Luxembourg and 1 moreGcore Luxembourg edge AI, cloud, CDN and security provider with GPU clusters in EuropeNeocloud 路 Other Nvidia GPUs 路 2011 Colossus 馃嚭馃嚫 United StatesColossus An AI supercomputer cluster in Tennessee and Mississippi built by xAI.Supercomputer 路 Nvidia Hopper 路 2024 馃嚠馃嚬 ItalyCINECA Italian university consortium running supercomputers for scientific researchSupercomputer 路 1969 The Stargate Project 馃嚭馃嚫 United States and 4 moreThe Stargate Project US AI infrastructure venture building data centres for OpenAISupercomputer 路 AMD Instinct 路 2025 Perlmutter 馃嚭馃嚫 United StatesPerlmutter A DOE supercomputer at NERSC for fusion and climate research.Supercomputer 路 Nvidia Ampere 路 2021 馃嚭馃嚫 United StatesTexas Advanced Computing Center University of Texas centre running supercomputers and storage for U.S. researchResearch cluster 路 Other Nvidia GPUs 路 2001 馃嚘馃嚭 AustraliaNational Computational Infrastructure Australia's national high-performance computing and data facility at ANU in CanberraSupercomputer 路 Other Nvidia GPUs 路 2007 馃嚛馃嚜 GermanyJUWELS Modular supercomputer at J眉lich with an AMD and Nvidia booster moduleSupercomputer 路 Nvidia Ampere 路 2020 Oak Ridge Leadership Computing 馃嚭馃嚫 United StatesOak Ridge Leadership Computing Facility US Department of Energy supercomputing user facility at Oak Ridge National LaboratorySupercomputer 路 Other and custom chips 路 1992 馃嚚馃嚦 ChinaBaidu Chinese search and AI group with its own cloud, chips and foundation modelsHyperscaler 路 Other and custom chips 路 2000 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 馃嚥馃嚲 Malaysia and 4 moreYTL AI Cloud Malaysian AI cloud and supercomputer run from a solar-backed Johor data centre parkNeocloud 路 Nvidia Blackwell 路 2024 Taiwania 馃嚬馃嚰 TaiwanTaiwania A series of supercomputers in Taiwan for scientific research and public access.Supercomputer 路 Other Nvidia GPUs 路 2018 馃嚜馃嚫 SpainBarcelona Supercomputing Center Spanish national supercomputing centre running the MareNostrum machine in BarcelonaResearch cluster 路 Other Nvidia GPUs 路 2005 Nebius Group 馃嚦馃嚤 Netherlands and 2 moreNebius Group AI infrastructure company offering GPU cloud services, listed on Nasdaq.Neocloud 路 Other Nvidia GPUs 路 2004 Hyperion 馃嚭馃嚫 United StatesHyperion A planned AI data center in Louisiana owned by Meta Platforms.Hyperscaler Tencent Cloud 馃嚚馃嚦 China and 4 moreTencent Cloud Tencent's global cloud arm: 66 availability zones, 700+ services, AI and media toolsHyperscaler 路 2013 馃嚚馃嚟 SwitzerlandSwiss National Supercomputing Centre Switzerland's national high-performance computing centre, run by ETH Zurich in Lugano.Supercomputer 路 1992 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 Selene 馃嚭馃嚫 United StatesSelene Nvidia's own DGX SuperPOD supercomputer, built in three months in 2020Supercomputer 路 Nvidia Ampere 路 2020 馃嚚馃嚟 SwitzerlandAlps Swiss national supercomputer using Nvidia GH200 chips for AI and scientific research.Supercomputer 路 Other Nvidia GPUs 路 2024 Centre for Development of Adva 馃嚠馃嚦 IndiaCentre for Development of Advanced Computing Indian government society building supercomputers and advanced computing systemsSupercomputer 路 Other and custom chips 路 1988 Taiwania 3 馃嚬馃嚰 TaiwanTaiwania 3 A CPU-based supercomputer for scientific research and biomedical analysis in Taiwan.Supercomputer 路 Other Nvidia GPUs 路 2020 馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 Starcloud 馃嚭馃嚫 United StatesStarcloud Orbital data centres built and operated by a US space computing companyNeocloud 路 Nvidia Hopper 路 2023 馃嚠馃嚬 Italy and 1 moreGalileo Italian national Tier-1 supercomputer for scientific and technical computingSupercomputer 路 Other Nvidia GPUs 路 2015 Genesis Mission 馃嚭馃嚫 United StatesGenesis Mission US federal programme using AI computing to speed up scientific researchSovereign cloud 路 2025 馃嚜馃嚫 SpainSpanish Supercomputing Network Spain's linked supercomputers offering free HPC time to research groupsSupercomputer 路 2007 馃嚥馃嚲 Malaysia and 4 moreYTL Corporation Malaysian infrastructure group running AI data centres and Nvidia cloud capacityNeocloud 路 Other Nvidia GPUs 路 1955 馃嚡馃嚨 Japan and 2 moreSoftBank Group Japanese investment group behind the Stargate AI infrastructure projectSovereign cloud 路 1981 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 Christofari 馃嚪馃嚭 RussiaChristofari Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer 路 Other Nvidia GPUs 路 2019 DiRAC 馃嚞馃嚙 United KingdomDiRAC UK supercomputing service for particle physics, astronomy and cosmology researchSupercomputer 路 2009 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 National Supercomputer Centre 馃嚫馃嚜 SwedenNational Supercomputer Centre in Sweden Swedish national supercomputer centre in Link枚ping, running Triolith.Supercomputer Gauss Centre for Supercomputin 馃嚛馃嚜 GermanyGauss Centre for Supercomputing Coordinates Germany's three national Tier-0 supercomputing centresSupercomputer 路 2007 馃嚭馃嚫 United StatesNational Center for Supercomputing Applications US university centre supplying high-performance computing to researchers nationwideResearch cluster 路 1986 Voyager-EUS2 馃嚭馃嚫 United StatesVoyager-EUS2 Microsoft Azure supercomputer in the East US 2 regionSupercomputer 路 Nvidia Ampere EuroHPC Joint Undertaking 馃嚤馃嚭 Luxembourg and 4 moreEuroHPC Joint Undertaking EU public-private partnership building a pan-European supercomputing and AI infrastructureSupercomputer 路 Other and custom chips 路 2018

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.