News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Training clusters

Reserved clusters of thousands of GPUs on one fabric. 105 providers on EveryNeocloud so far.

A training cluster is a block of hundreds to hundreds of thousands of GPUs joined on one fast network, reserved by one customer for months or years. This is how frontier models are trained, and it is the core business of the largest neoclouds. Deals are signed as contracts worth billions of dollars, often before the data centre is built.

What makes a cluster

Inside each server, GPUs talk over NVLink; between servers they use InfiniBand or fast Ethernet in a layout called a fat tree, so any GPU can reach any other at full speed. Shared storage feeds training data, and software such as Slurm or Kubernetes schedules jobs and restarts them when a GPU fails, which in a cluster of 100,000 GPUs happens many times a day.

How it is sold

Customers sign take-or-pay contracts: they pay for the capacity whether or not they use it. Microsoft, OpenAI, Meta and Google have signed such deals with CoreWeave, Nebius, Nscale, IREN and others. The contracts let providers borrow against them to buy GPUs. Critics say this ties a small number of buyers and lenders together; providers say long contracts make the business stable.

Famous training clusters providers

Further reading

Canadian Sovereign AI Compute 馃嚚馃嚘 CanadaCanadian Sovereign AI Compute Strategy National programme to build domestic AI infrastructure in CanadaSovereign cloud 路 2024 Voltage Park 馃嚭馃嚫 United StatesVoltage Park US GPU cloud selling on-demand and reserved AI compute from its own hardwareNeocloud 路 Other Nvidia GPUs Krutrim Cloud 馃嚠馃嚦 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs Fluence 馃嚚馃嚟 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud 路 Other Nvidia GPUs 路 2017 Shadeform 馃嚭馃嚫 United StatesShadeform Marketplace for GPU cloud access across multiple providersMarketplace 路 Other Nvidia GPUs TensorWave WorldTensorWave AMD-exclusive AI cloud for training and running large modelsNeocloud 路 AMD Instinct Microsoft Fairwater 馃嚭馃嚫 United StatesMicrosoft Fairwater Purpose-built AI supercomputer campus in WisconsinHyperscaler 路 Nvidia Blackwell 路 2025 Core42 馃嚘馃嚜 United Arab EmiratesCore42 Sovereign AI cloud and infrastructure provider based in the UAE.Sovereign cloud 路 Other Nvidia GPUs Together AI 馃嚭馃嚫 United StatesTogether AI AI cloud running open models on demand, with GPU clusters and inference researchNeocloud 路 Nvidia Blackwell Fluidstack WorldFluidstack Compute infrastructure company building large-scale AI data centresNeocloud 路 Other and custom chips Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell Radiant 馃嚞馃嚙 United KingdomRadiant AI compute infrastructure company building repeatable 'AI factories' powered by its FlightDeck platform.Neocloud 路 Nvidia Blackwell CUDO Compute 馃嚞馃嚙 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud 路 Nvidia Hopper GreenNode 馃嚮馃嚦 Vietnam and 1 moreGreenNode Sovereign AI and public cloud with GPU instances across Vietnam and ThailandNeocloud Ubilink 馃嚬馃嚰 TaiwanUbilink Taiwanese AI supercomputing firm running an NVIDIA H100 clusterSupercomputer 路 Nvidia Hopper Ubitus 馃嚡馃嚨 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud 路 Other Nvidia GPUs 路 2012 Sesterce 馃嚝馃嚪 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud 路 Other Nvidia GPUs E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell Polarise 馃嚛馃嚜 GermanyPolarise German sovereign AI cloud running its own data centres and open-weight model APIsNeocloud 路 Nvidia Blackwell 路 2024 Anyscale 馃嚭馃嚫 United States and 1 moreAnyscale Managed Ray platform for distributed AI workloadsDeveloper cloud 路 Other Nvidia GPUs Nvidia DGX Cloud 馃嚭馃嚫 United StatesNvidia DGX Cloud Nvidia's internal cloud for AI development and operationsHyperscaler 路 Other Nvidia GPUs Modal 馃嚭馃嚫 United States and 1 moreModal Serverless cloud platform for AI development and inferenceDeveloper cloud 路 Other Nvidia GPUs RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell Lightning AI 馃嚭馃嚫 United StatesLightning AI AI cloud platform with owned GPU infrastructureNeocloud 路 Other Nvidia GPUs 路 2026 Vast.ai 馃嚭馃嚫 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016 Io.net WorldIo.net Decentralised network for GPU computeMarketplace 路 Other Nvidia GPUs 路 2023 Applied Digital 馃嚭馃嚫 United StatesApplied Digital Builder and operator of large-scale AI data centresNeocloud 路 2021 Eos 馃嚭馃嚫 United StatesEos Nvidia's DGX SuperPOD AI supercomputer for internal researchSupercomputer 路 Nvidia Hopper 路 2023 Horizon 馃嚭馃嚫 United StatesHorizon Largest academic supercomputer in the United StatesSupercomputer 路 Nvidia Blackwell 路 2026 Hyperstack 馃嚞馃嚙 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud 路 Other Nvidia GPUs 路 2020 Berzelius 馃嚫馃嚜 SwedenBerzelius Swedish AI supercomputer at Link枚ping UniversitySupercomputer 路 Nvidia Ampere Gefion EuropeGefion Denmark's sovereign AI supercomputer for science and industrySovereign cloud 路 Nvidia Hopper ASPIRE 2A+ 馃嚫馃嚞 SingaporeASPIRE 2A+ Singapore national AI supercomputer with 320 Nvidia H100 GPUsSupercomputer 路 Nvidia Hopper Cortex 馃嚭馃嚫 United StatesCortex Tesla's AI training cluster for autonomous driving and robotics.Supercomputer 路 Nvidia Hopper Stargate Norway 馃嚦馃嚧 NorwayStargate Norway 100,000 GPU AI infrastructure project in Northern NorwaySovereign cloud 路 Nvidia Blackwell 路 2025 Firmus 馃嚘馃嚭 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud 路 Nvidia Blackwell Arc Compute 馃嚭馃嚫 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud 路 Nvidia Blackwell 路 2018 AI Research Resource 馃嚞馃嚙 United KingdomAI Research Resource UK national supercomputing programme for AI research and industrySovereign cloud 路 Nvidia Hopper 路 2023 EuroHPC AI Factories EuropeEuroHPC AI Factories Pan-European network of AI-optimised supercomputing hubsSovereign cloud 路 Other Nvidia GPUs 路 2024 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper Sharon AI 馃嚘馃嚭 Australia and 1 moreSharon AI Australian firm building AI data centres and GPU cloud capacityNeocloud Hot Aisle WorldHot Aisle Developer-first cloud for sovereign inference on isolated AMD GPUsNeocloud 路 AMD Instinct 路 2023 Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper IndiaAI Compute Portal 馃嚠馃嚦 IndiaIndiaAI Compute Portal National cloud platform for affordable AI compute in IndiaSovereign cloud 路 Nvidia Hopper Latitude.sh 馃嚭馃嚫 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs Hon Hai Kaohsiung Super Comput 馃嚬馃嚰 TaiwanHon Hai Kaohsiung Super Computing Center Taiwan鈥檚 fastest AI supercomputer built by Foxconn and NvidiaSupercomputer 路 Nvidia Blackwell 路 2025 Lambda 馃嚭馃嚫 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.