News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Managed Kubernetes

Container platforms tuned for AI. 32 providers on EveryNeocloud so far.

Kubernetes is open-source software, first released by Google in 2014, that runs programs in containers across many servers and restarts them when they fail. Most AI clouds now offer it as a managed service tuned for GPUs, so customers can run training and inference without managing the machines underneath. CoreWeave built its cloud around Kubernetes from the start.

Why AI teams use it

Containers package a model with all the software it needs, so it runs the same way on any machine. Kubernetes spreads those containers across GPU servers, scales them up when traffic rises and down when it falls, and moves work off broken servers. Add-ons let it schedule GPU jobs in groups, so a training run starts only when all its GPUs are free.

Who offers it

All three big clouds have managed Kubernetes services. Among neoclouds, CoreWeave runs its own Kubernetes service on bare metal, and Nebius, Lambda and Nscale offer managed clusters. Developer clouds such as DigitalOcean and Linode include it, and Rackspace Spot sells Kubernetes clusters at auction prices. Many research teams still prefer Slurm, the older job scheduler of supercomputers.

Famous managed Kubernetes providers

Still to be written: Google Cloud Platform.

Further reading

馃嚠馃嚬 Italy and 3 moreAruba Italian data centre and cloud provider running its own campuses across Italy and EuropeNeocloud 路 1994 Tencent Cloud 馃嚚馃嚦 China and 4 moreTencent Cloud Tencent's global cloud arm: 66 availability zones, 700+ services, AI and media toolsHyperscaler 路 2013 DigitalOcean 馃嚭馃嚫 United States and 2 moreDigitalOcean Alternative cloud for developers, with GPU Droplets for AI workDeveloper cloud 路 Nvidia Hopper 路 2011 馃嚠馃嚦 IndiaJio Platforms Reliance's holding group for Jio telecom, apps, cloud and AI servicesHyperscaler 路 2019 Rackspace Technology 馃嚭馃嚫 United States and 4 moreRackspace Technology Managed cloud and AI services firm running data centres worldwideNeocloud 路 1998 Linode 馃嚭馃嚫 United StatesLinode Linux virtual machines and cloud infrastructure, now part of AkamaiDeveloper cloud 路 2003 Latitude.sh 馃嚭馃嚫 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs Hyperstack 馃嚞馃嚙 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud 路 Other Nvidia GPUs 路 2020 Krutrim Cloud 馃嚠馃嚦 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs Seeweb 馃嚠馃嚬 ItalySeeweb European cloud provider with GPU and Kubernetes servicesNeocloud 路 Other Nvidia GPUs NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 Anyscale 馃嚭馃嚫 United States and 1 moreAnyscale Managed Ray platform for distributed AI workloadsDeveloper cloud 路 Other Nvidia GPUs Modal 馃嚭馃嚫 United States and 1 moreModal Serverless cloud platform for AI development and inferenceDeveloper cloud 路 Other Nvidia GPUs Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.