News
MinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealInferenceIndia Startup Sells DeepSeek Access While Pursuing Sovereign AIClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceMinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealInferenceIndia Startup Sells DeepSeek Access While Pursuing Sovereign AIClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and Inference
EveryNeocloud

Training clusters

Reserved clusters of thousands of GPUs on one fabric. 105 providers on EveryNeocloud so far.

A training cluster is a block of hundreds to hundreds of thousands of GPUs joined on one fast network, reserved by one customer for months or years. This is how frontier models are trained, and it is the core business of the largest neoclouds. Deals are signed as contracts worth billions of dollars, often before the data centre is built.

What makes a cluster

Inside each server, GPUs talk over NVLink; between servers they use InfiniBand or fast Ethernet in a layout called a fat tree, so any GPU can reach any other at full speed. Shared storage feeds training data, and software such as Slurm or Kubernetes schedules jobs and restarts them when a GPU fails, which in a cluster of 100,000 GPUs happens many times a day.

How it is sold

Customers sign take-or-pay contracts: they pay for the capacity whether or not they use it. Microsoft, OpenAI, Meta and Google have signed such deals with CoreWeave, Nebius, Nscale, IREN and others. The contracts let providers borrow against them to buy GPUs. Critics say this ties a small number of buyers and lenders together; providers say long contracts make the business stable.

Famous training clusters providers

Further reading

🇺🇸 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud · Nvidia Hopper · 2017 Starcloud 🇺🇸 United StatesStarcloud Orbital data centres built and operated by a US space computing companyNeocloud · Nvidia Hopper · 2023 G42 🇦🇪 United Arab Emirates and 4 moreG42 Abu Dhabi AI holding group running cloud, data centres and national compute projectsNeocloud · Nvidia Blackwell · 2018 🇺🇸 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud · Nvidia Hopper · 2023 🇲🇾 Malaysia and 4 moreYTL Corporation Malaysian infrastructure group running AI data centres and Nvidia cloud capacityNeocloud · Other Nvidia GPUs · 1955 Gcore 🇱🇺 Luxembourg and 1 moreGcore Luxembourg edge AI, cloud, CDN and security provider with GPU clusters in EuropeNeocloud · Other Nvidia GPUs · 2011 🇲🇾 Malaysia and 4 moreYTL AI Cloud Malaysian AI cloud and supercomputer run from a solar-backed Johor data centre parkNeocloud · Nvidia Blackwell · 2024 IREN 🇦🇺 Australia and 2 moreIREN Australian GPU cloud and data centre operator for AI workloadsNeocloud · Other Nvidia GPUs · 2018 Humain 🇸🇦 Saudi ArabiaHumain Saudi AI company building data centres, cloud services and Arabic modelsNeocloud · Other Nvidia GPUs · 2025 Northern Data 🇩🇪 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud · Nvidia Hopper · 2019 Nebius Group 🇳🇱 Netherlands and 2 moreNebius Group AI infrastructure company offering GPU cloud services, listed on Nasdaq.Neocloud · Other Nvidia GPUs · 2004 🇷🇺 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud · Other Nvidia GPUs · 1997 Megaspeed 🇸🇬 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud · Nvidia Blackwell · 2015 Jarvislabs 🇮🇳 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud · Nvidia Hopper Stargate Norway 🇳🇴 NorwayStargate Norway 100,000 GPU AI infrastructure project in Northern NorwaySovereign cloud · Nvidia Blackwell · 2025 Fluidstack WorldFluidstack Compute infrastructure company building large-scale AI data centresNeocloud · Other and custom chips WhiteFiber 🇺🇸 United StatesWhiteFiber AI data centres, private GPU clouds and reserved GPU capacity in North AmericaNeocloud · Nvidia Blackwell Voltage Park 🇺🇸 United StatesVoltage Park US GPU cloud selling on-demand and reserved AI compute from its own hardwareNeocloud · Other Nvidia GPUs TensorWave WorldTensorWave AMD-exclusive AI cloud for training and running large modelsNeocloud · AMD Instinct Together AI 🇺🇸 United StatesTogether AI AI cloud running open models on demand, with GPU clusters and inference researchNeocloud · Nvidia Blackwell Crusoe 🇺🇸 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud · Nvidia Blackwell Radiant 🇬🇧 United KingdomRadiant AI compute infrastructure company building repeatable 'AI factories' powered by its FlightDeck platform.Neocloud · Nvidia Blackwell CUDO Compute 🇬🇧 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud · Nvidia Hopper GreenNode 🇻🇳 Vietnam and 1 moreGreenNode Sovereign AI and public cloud with GPU instances across Vietnam and ThailandNeocloud Ubilink 🇹🇼 TaiwanUbilink Taiwanese AI supercomputing firm running an NVIDIA H100 clusterSupercomputer · Nvidia Hopper Ubitus 🇯🇵 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud · Other Nvidia GPUs · 2012 Sesterce 🇫🇷 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud · Other Nvidia GPUs Verda 🇫🇮 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud · Nvidia Blackwell RunPod 🇺🇸 United StatesRunPod AI developer cloud for training and inferenceNeocloud · Nvidia Blackwell Lightning AI 🇺🇸 United StatesLightning AI AI cloud platform with owned GPU infrastructureNeocloud · Other Nvidia GPUs · 2026 Vast.ai 🇺🇸 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace · Nvidia Blackwell · 2016 Applied Digital 🇺🇸 United StatesApplied Digital Builder and operator of large-scale AI data centresNeocloud · 2021 Yotta Shakti Cloud 🇮🇳 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud · Nvidia Hopper Latitude.sh 🇺🇸 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud · Other Nvidia GPUs Krutrim Cloud 🇮🇳 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud · Other Nvidia GPUs Fluence 🇨🇭 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud · Other Nvidia GPUs · 2017 Core42 🇦🇪 United Arab EmiratesCore42 Sovereign AI cloud and infrastructure provider based in the UAE.Sovereign cloud · Other Nvidia GPUs E2E Networks 🇮🇳 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud · Nvidia Hopper · 2009 Polarise 🇩🇪 GermanyPolarise German sovereign AI cloud running its own data centres and open-weight model APIsNeocloud · Nvidia Blackwell · 2024 Hyperstack 🇬🇧 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud · Other Nvidia GPUs · 2020 Firmus 🇦🇺 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud · Nvidia Blackwell Arc Compute 🇺🇸 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud · Nvidia Blackwell · 2018 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud · Nvidia Hopper Sharon AI 🇦🇺 Australia and 1 moreSharon AI Australian firm building AI data centres and GPU cloud capacityNeocloud Hot Aisle WorldHot Aisle Developer-first cloud for sovereign inference on isolated AMD GPUsNeocloud · AMD Instinct · 2023 Lambda 🇺🇸 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud · Nvidia Blackwell · 2012 Hydra Host 🇺🇸 United StatesHydra Host Bare metal GPU platform and Brokkr software for independent AI FactoriesNeocloud NHN Cloud 🇰🇷 South KoreaNHN Cloud South Korean cloud provider with large GPU clusters for AI trainingNeocloud · Nvidia Blackwell

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.