News
Inferenceai& to Provide NEC with Sovereign AI Inference Platform to Accelerate AI-Native TransformationSovereignDeutsche Telekom boosts its sovereign AI push with 100 million for MistralInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesClustersIntroducing Together Storage Accelerator: fast, free data caching for your GPU clusterNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip CurbsInferenceai& to Provide NEC with Sovereign AI Inference Platform to Accelerate AI-Native TransformationSovereignDeutsche Telekom boosts its sovereign AI push with 100 million for MistralInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesClustersIntroducing Together Storage Accelerator: fast, free data caching for your GPU clusterNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip Curbs
EveryNeocloud

Managed Kubernetes

Container platforms tuned for AI. 32 providers on EveryNeocloud so far.

Kubernetes is open-source software, first released by Google in 2014, that runs programs in containers across many servers and restarts them when they fail. Most AI clouds now offer it as a managed service tuned for GPUs, so customers can run training and inference without managing the machines underneath. CoreWeave built its cloud around Kubernetes from the start.

Why AI teams use it

Containers package a model with all the software it needs, so it runs the same way on any machine. Kubernetes spreads those containers across GPU servers, scales them up when traffic rises and down when it falls, and moves work off broken servers. Add-ons let it schedule GPU jobs in groups, so a training run starts only when all its GPUs are free.

Who offers it

All three big clouds have managed Kubernetes services. Among neoclouds, CoreWeave runs its own Kubernetes service on bare metal, and Nebius, Lambda and Nscale offer managed clusters. Developer clouds such as DigitalOcean and Linode include it, and Rackspace Spot sells Kubernetes clusters at auction prices. Many research teams still prefer Slurm, the older job scheduler of supercomputers.

Famous managed Kubernetes providers

Still to be written: Google Cloud Platform.

Further reading

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.