News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to Nvidia
EveryNeocloud

Managed Kubernetes

Container platforms tuned for AI. 32 providers on EveryNeocloud so far.

Kubernetes is open-source software, first released by Google in 2014, that runs programs in containers across many servers and restarts them when they fail. Most AI clouds now offer it as a managed service tuned for GPUs, so customers can run training and inference without managing the machines underneath. CoreWeave built its cloud around Kubernetes from the start.

Why AI teams use it

Containers package a model with all the software it needs, so it runs the same way on any machine. Kubernetes spreads those containers across GPU servers, scales them up when traffic rises and down when it falls, and moves work off broken servers. Add-ons let it schedule GPU jobs in groups, so a training run starts only when all its GPUs are free.

Who offers it

All three big clouds have managed Kubernetes services. Among neoclouds, CoreWeave runs its own Kubernetes service on bare metal, and Nebius, Lambda and Nscale offer managed clusters. Developer clouds such as DigitalOcean and Linode include it, and Rackspace Spot sells Kubernetes clusters at auction prices. Many research teams still prefer Slurm, the older job scheduler of supercomputers.

Famous managed Kubernetes providers

Still to be written: Google Cloud Platform.

Further reading

馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 馃嚭馃嚫 United States and 1 moreAmazon Elastic Compute Cloud AWS service for renting virtual servers by the secondHyperscaler 路 Other Nvidia GPUs 路 2006 Oracle Cloud 馃嚭馃嚫 United States and 4 moreOracle Cloud Oracle's global cloud for servers, storage, databases and GPU computeHyperscaler 路 Other Nvidia GPUs 路 2016 Yandex Cloud 馃嚪馃嚭 RussiaYandex Cloud Yandex's public cloud, offering compute, data and ML services to Russian businessesHyperscaler 路 Other Nvidia GPUs 路 2018 NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace 路 Other Nvidia GPUs Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell Anyscale 馃嚭馃嚫 United States and 1 moreAnyscale Managed Ray platform for distributed AI workloadsDeveloper cloud 路 Other Nvidia GPUs Modal 馃嚭馃嚫 United States and 1 moreModal Serverless cloud platform for AI development and inferenceDeveloper cloud 路 Other Nvidia GPUs Siam AI 馃嚬馃嚟 ThailandSiam AI GPU cloud provider based in Thailand for enterprise workloadsNeocloud 路 Other Nvidia GPUs Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011 Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper Latitude.sh 馃嚭馃嚫 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs Krutrim Cloud 馃嚠馃嚦 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs Seeweb 馃嚠馃嚬 ItalySeeweb European cloud provider with GPU and Kubernetes servicesNeocloud 路 Other Nvidia GPUs Hyperstack 馃嚞馃嚙 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud 路 Other Nvidia GPUs 路 2020

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.