News
MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)
EveryNeocloud

Training clusters

Reserved clusters of thousands of GPUs on one fabric. 105 providers on EveryNeocloud so far.

A training cluster is a block of hundreds to hundreds of thousands of GPUs joined on one fast network, reserved by one customer for months or years. This is how frontier models are trained, and it is the core business of the largest neoclouds. Deals are signed as contracts worth billions of dollars, often before the data centre is built.

What makes a cluster

Inside each server, GPUs talk over NVLink; between servers they use InfiniBand or fast Ethernet in a layout called a fat tree, so any GPU can reach any other at full speed. Shared storage feeds training data, and software such as Slurm or Kubernetes schedules jobs and restarts them when a GPU fails, which in a cluster of 100,000 GPUs happens many times a day.

How it is sold

Customers sign take-or-pay contracts: they pay for the capacity whether or not they use it. Microsoft, OpenAI, Meta and Google have signed such deals with CoreWeave, Nebius, Nscale, IREN and others. The contracts let providers borrow against them to buy GPUs. Critics say this ties a small number of buyers and lenders together; providers say long contracts make the business stable.

Famous training clusters providers

Further reading

Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 Starcloud 馃嚭馃嚫 United StatesStarcloud Orbital data centres built and operated by a US space computing companyNeocloud 路 Nvidia Hopper 路 2023 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell Lambda 馃嚭馃嚫 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012 Jarvislabs 馃嚠馃嚦 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell CUDO Compute 馃嚞馃嚙 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud 路 Nvidia Hopper Ubilink 馃嚬馃嚰 TaiwanUbilink Taiwanese AI supercomputing firm running an NVIDIA H100 clusterSupercomputer 路 Nvidia Hopper Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper Arc Compute 馃嚭馃嚫 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud 路 Nvidia Blackwell 路 2018

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.