News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory’s NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory’s NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Managed Kubernetes

Container platforms tuned for AI. 32 providers on EveryNeocloud so far.

Kubernetes is open-source software, first released by Google in 2014, that runs programs in containers across many servers and restarts them when they fail. Most AI clouds now offer it as a managed service tuned for GPUs, so customers can run training and inference without managing the machines underneath. CoreWeave built its cloud around Kubernetes from the start.

Why AI teams use it

Containers package a model with all the software it needs, so it runs the same way on any machine. Kubernetes spreads those containers across GPU servers, scales them up when traffic rises and down when it falls, and moves work off broken servers. Add-ons let it schedule GPU jobs in groups, so a training run starts only when all its GPUs are free.

Who offers it

All three big clouds have managed Kubernetes services. Among neoclouds, CoreWeave runs its own Kubernetes service on bare metal, and Nebius, Lambda and Nscale offer managed clusters. Developer clouds such as DigitalOcean and Linode include it, and Rackspace Spot sells Kubernetes clusters at auction prices. Many research teams still prefer Slurm, the older job scheduler of supercomputers.

Famous managed Kubernetes providers

Still to be written: Google Cloud Platform.

Further reading

Linode 🇺🇸 United StatesLinode Linux virtual machines and cloud infrastructure, now part of AkamaiDeveloper cloud · 2003 IBM Cloud 🇺🇸 United States and 3 moreIBM Cloud IBM's hybrid cloud platform spanning data centres, bare metal and managed KubernetesHyperscaler 🇺🇸 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud · Nvidia Hopper · 2017 Oracle Cloud 🇺🇸 United States and 4 moreOracle Cloud Oracle's global cloud for servers, storage, databases and GPU computeHyperscaler · Other Nvidia GPUs · 2016 Tencent Cloud 🇨🇳 China and 4 moreTencent Cloud Tencent's global cloud arm: 66 availability zones, 700+ services, AI and media toolsHyperscaler · 2013 DigitalOcean 🇺🇸 United States and 2 moreDigitalOcean Alternative cloud for developers, with GPU Droplets for AI workDeveloper cloud · Nvidia Hopper · 2011 🇮🇹 Italy and 3 moreAruba Italian data centre and cloud provider running its own campuses across Italy and EuropeNeocloud · 1994 🇺🇸 United States and 1 moreAmazon Elastic Compute Cloud AWS service for renting virtual servers by the secondHyperscaler · Other Nvidia GPUs · 2006 Azure 🇺🇸 United StatesAzure Microsoft's global cloud computing platform for infrastructure and AI services.Hyperscaler · Nvidia Ampere · 2010 SambaNova Systems 🇺🇸 United StatesSambaNova Systems American provider of custom AI silicon and cloud inference services based on Reconfigurable Dataflow Units.Neocloud · Other and custom chips · 2017 🇨🇳 China and 4 moreAlibaba Cloud China's largest cloud provider, running global data centres and the Qwen modelsHyperscaler · Other and custom chips · 2009 🇮🇳 IndiaJio Platforms Reliance's holding group for Jio telecom, apps, cloud and AI servicesHyperscaler · 2019 Rackspace Technology 🇺🇸 United States and 4 moreRackspace Technology Managed cloud and AI services firm running data centres worldwideNeocloud · 1998 Schwarz Digits 🇩🇪 Germany and 1 moreSchwarz Digits German retail group's IT arm running the STACKIT sovereign cloudSovereign cloud · 2023 Yandex Cloud 🇷🇺 RussiaYandex Cloud Yandex's public cloud, offering compute, data and ML services to Russian businessesHyperscaler · Other Nvidia GPUs · 2018 Crusoe 🇺🇸 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud · Nvidia Blackwell GreenNode 🇻🇳 Vietnam and 1 moreGreenNode Sovereign AI and public cloud with GPU instances across Vietnam and ThailandNeocloud Anyscale 🇺🇸 United States and 1 moreAnyscale Managed Ray platform for distributed AI workloadsDeveloper cloud · Other Nvidia GPUs Modal 🇺🇸 United States and 1 moreModal Serverless cloud platform for AI development and inferenceDeveloper cloud · Other Nvidia GPUs Siam AI 🇹🇭 ThailandSiam AI GPU cloud provider based in Thailand for enterprise workloadsNeocloud · Other Nvidia GPUs Exoscale 🇨🇭 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud · Other Nvidia GPUs · 2011 Hyperbolic 🇺🇸 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace · Nvidia Hopper Yotta Shakti Cloud 🇮🇳 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud · Nvidia Hopper Neysa 🇮🇳 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud · Other Nvidia GPUs Latitude.sh 🇺🇸 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud · Other Nvidia GPUs Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace · Other Nvidia GPUs NodeShift 🇬🇧 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace · Other Nvidia GPUs · 2024 Seeweb 🇮🇹 ItalySeeweb European cloud provider with GPU and Kubernetes servicesNeocloud · Other Nvidia GPUs Krutrim Cloud 🇮🇳 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud · Other Nvidia GPUs Mithril 🇺🇸 United StatesMithril A GPU VM marketplace with spot bids and flexible reservations for AI workloadsMarketplace NHN Cloud 🇰🇷 South KoreaNHN Cloud South Korean cloud provider with large GPU clusters for AI trainingNeocloud · Nvidia Blackwell Hyperstack 🇬🇧 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud · Other Nvidia GPUs · 2020

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.