News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inference
EveryNeocloud

Bare-metal GPUs

Whole servers, with no virtual layer. 85 providers on EveryNeocloud so far.

A bare-metal GPU server is a whole physical machine rented to one customer, with no hypervisor, the software layer that splits a server into virtual machines. The customer gets every GPU, all the memory and direct access to the network cards. Neoclouds such as CoreWeave built their business on bare metal, and hosts such as Hetzner, OVHcloud and Leaseweb have long rented dedicated servers.

Why AI teams want it

Large training jobs need every bit of speed, and a virtual layer can slow the links between GPUs and to the network. On bare metal, GPUs talk to each other through NVLink and to other servers through InfiniBand or RoCE, a fast Ethernet method, with nothing in between. Teams can also install their own drivers and tools. The trade-off is that the customer manages more of the system.

How it is sold

Bare-metal GPU servers are usually rented by the month or on reserved contracts, often as eight-GPU nodes. Many providers wrap bare metal in Kubernetes or a job scheduler such as Slurm, so customers get the speed of bare metal with tools to run jobs. Providers compete on how fast they can hand over healthy servers and how they handle failures.

Famous bare-metal GPUs providers

Still to be written: Leaseweb, Vultr.

Further reading

Colossus 馃嚭馃嚫 United StatesColossus An AI supercomputer cluster in Tennessee and Mississippi built by xAI.Supercomputer 路 Nvidia Hopper 路 2024 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 Lambda 馃嚭馃嚫 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012 Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell CUDO Compute 馃嚞馃嚙 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud 路 Nvidia Hopper Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper GPU Mart 馃嚭馃嚫 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud 路 Nvidia Blackwell 路 2021 Hyperbolic 馃嚭馃嚫 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace 路 Nvidia Hopper Spheron Network WorldSpheron Network Marketplace for renting enterprise NVIDIA and AMD GPUsMarketplace 路 Nvidia Blackwell Lium 馃嚢馃嚦 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace 路 Nvidia Blackwell Phala Cloud 馃嚭馃嚫 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper Beam WorldBeam Developer cloud for AI agents and GPU workloadsDeveloper cloud 路 Other Nvidia GPUs Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Arc Compute 馃嚭馃嚫 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud 路 Nvidia Blackwell 路 2018 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.