News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory’s NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory’s NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Training clusters

Reserved clusters of thousands of GPUs on one fabric. 105 providers on EveryNeocloud so far.

A training cluster is a block of hundreds to hundreds of thousands of GPUs joined on one fast network, reserved by one customer for months or years. This is how frontier models are trained, and it is the core business of the largest neoclouds. Deals are signed as contracts worth billions of dollars, often before the data centre is built.

What makes a cluster

Inside each server, GPUs talk over NVLink; between servers they use InfiniBand or fast Ethernet in a layout called a fat tree, so any GPU can reach any other at full speed. Shared storage feeds training data, and software such as Slurm or Kubernetes schedules jobs and restarts them when a GPU fails, which in a cluster of 100,000 GPUs happens many times a day.

How it is sold

Customers sign take-or-pay contracts: they pay for the capacity whether or not they use it. Microsoft, OpenAI, Meta and Google have signed such deals with CoreWeave, Nebius, Nscale, IREN and others. The contracts let providers borrow against them to buy GPUs. Critics say this ties a small number of buyers and lenders together; providers say long contracts make the business stable.

Famous training clusters providers

Further reading

Selene 🇺🇸 United StatesSelene Nvidia's own DGX SuperPOD supercomputer, built in three months in 2020Supercomputer · Nvidia Ampere · 2020 🇺🇸 United StatesNCAR-Wyoming Supercomputing Center A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer · Other Nvidia GPUs · 2003 Perlmutter 🇺🇸 United StatesPerlmutter A DOE supercomputer at NERSC for fusion and climate research.Supercomputer · Nvidia Ampere · 2021 🇩🇪 GermanyJUWELS Modular supercomputer at Jülich with an AMD and Nvidia booster moduleSupercomputer · Nvidia Ampere · 2020 Christofari 🇷🇺 RussiaChristofari Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer · Other Nvidia GPUs · 2019 Voyager-EUS2 🇺🇸 United StatesVoyager-EUS2 Microsoft Azure supercomputer in the East US 2 regionSupercomputer · Nvidia Ampere Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace · Nvidia Hopper Berzelius 🇸🇪 SwedenBerzelius Swedish AI supercomputer at Linköping UniversitySupercomputer · Nvidia Ampere Verda 🇫🇮 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud · Nvidia Blackwell RunPod 🇺🇸 United StatesRunPod AI developer cloud for training and inferenceNeocloud · Nvidia Blackwell IndiaAI Compute Portal 🇮🇳 IndiaIndiaAI Compute Portal National cloud platform for affordable AI compute in IndiaSovereign cloud · Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.