News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inference
EveryNeocloud

Bare-metal GPUs

Whole servers, with no virtual layer. 85 providers on EveryNeocloud so far.

A bare-metal GPU server is a whole physical machine rented to one customer, with no hypervisor, the software layer that splits a server into virtual machines. The customer gets every GPU, all the memory and direct access to the network cards. Neoclouds such as CoreWeave built their business on bare metal, and hosts such as Hetzner, OVHcloud and Leaseweb have long rented dedicated servers.

Why AI teams want it

Large training jobs need every bit of speed, and a virtual layer can slow the links between GPUs and to the network. On bare metal, GPUs talk to each other through NVLink and to other servers through InfiniBand or RoCE, a fast Ethernet method, with nothing in between. Teams can also install their own drivers and tools. The trade-off is that the customer manages more of the system.

How it is sold

Bare-metal GPU servers are usually rented by the month or on reserved contracts, often as eight-GPU nodes. Many providers wrap bare metal in Kubernetes or a job scheduler such as Slurm, so customers get the speed of bare metal with tools to run jobs. Providers compete on how fast they can hand over healthy servers and how they handle failures.

Famous bare-metal GPUs providers

Still to be written: Leaseweb, Vultr.

Further reading

Ionstream 🇺🇸 United StatesIonstream Bare-metal NVIDIA GPU servers with automated provisioning and optimised networkingNeocloud · Other Nvidia GPUs Yotta Shakti Cloud 🇮🇳 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud · Nvidia Hopper ESDS 🇮🇳 IndiaESDS Indian-owned cloud and data centre provider with AI infrastructure.Neocloud · Other Nvidia GPUs · 2005 RackBank 🇮🇳 IndiaRackBank AI data centre provider in India offering bare metal GPU hosting.Neocloud · Other Nvidia GPUs Latitude.sh 🇺🇸 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud · Other Nvidia GPUs Krutrim Cloud 🇮🇳 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud · Other Nvidia GPUs Avian 🇺🇸 United StatesAvian Serverless and dedicated GPU inference for open-source modelsInference platform · Nvidia Blackwell Microsoft Fairwater 🇺🇸 United StatesMicrosoft Fairwater Purpose-built AI supercomputer campus in WisconsinHyperscaler · Nvidia Blackwell · 2025 Soluna 🇺🇸 United StatesSoluna Renewable energy-powered AI and Bitcoin cloudNeocloud · Other Nvidia GPUs Core42 🇦🇪 United Arab EmiratesCore42 Sovereign AI cloud and infrastructure provider based in the UAE.Sovereign cloud · Other Nvidia GPUs Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace · Nvidia Hopper Targon 🇺🇸 United StatesTargon On-demand NVIDIA GPU cloud for training and inferenceNeocloud · Other Nvidia GPUs Beam WorldBeam Developer cloud for AI agents and GPU workloadsDeveloper cloud · Other Nvidia GPUs E2E Networks 🇮🇳 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud · Nvidia Hopper · 2009 Polarise 🇩🇪 GermanyPolarise German sovereign AI cloud running its own data centres and open-weight model APIsNeocloud · Nvidia Blackwell · 2024 Hyperstack 🇬🇧 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud · Other Nvidia GPUs · 2020 Firmus 🇦🇺 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud · Nvidia Blackwell Arc Compute 🇺🇸 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud · Nvidia Blackwell · 2018 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud · Nvidia Hopper Hot Aisle WorldHot Aisle Developer-first cloud for sovereign inference on isolated AMD GPUsNeocloud · AMD Instinct · 2023 Lambda 🇺🇸 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud · Nvidia Blackwell · 2012 Hydra Host 🇺🇸 United StatesHydra Host Bare metal GPU platform and Brokkr software for independent AI FactoriesNeocloud NHN Cloud 🇰🇷 South KoreaNHN Cloud South Korean cloud provider with large GPU clusters for AI trainingNeocloud · Nvidia Blackwell SF Compute 🇺🇸 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud · Other Nvidia GPUs Aethir WorldAethir Distributed cloud GPU network for AI and gamingMarketplace · Other Nvidia GPUs HIVE Digital Technologies 🇨🇦 Canada and 2 moreHIVE Digital Technologies Clean-energy data centres for crypto mining and AI computeFormer miner · Other Nvidia GPUs · 2017 Neysa 🇮🇳 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud · Other Nvidia GPUs WhiteFiber 🇺🇸 United StatesWhiteFiber AI data centres, private GPU clouds and reserved GPU capacity in North AmericaNeocloud · Nvidia Blackwell Voltage Park 🇺🇸 United StatesVoltage Park US GPU cloud selling on-demand and reserved AI compute from its own hardwareNeocloud · Other Nvidia GPUs TensorWave WorldTensorWave AMD-exclusive AI cloud for training and running large modelsNeocloud · AMD Instinct Chutes WorldChutes Serverless, decentralised compute for running open-source AI models in productionInference platform Crusoe 🇺🇸 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud · Nvidia Blackwell Radiant 🇬🇧 United KingdomRadiant AI compute infrastructure company building repeatable 'AI factories' powered by its FlightDeck platform.Neocloud · Nvidia Blackwell CUDO Compute 🇬🇧 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud · Nvidia Hopper Massed Compute 🇺🇸 United StatesMassed Compute GPU cloud with per-second pricing and no bandwidth billingNeocloud Highreso 🇯🇵 JapanHighreso Japanese GPU cloud operator running its own GPU-only data centresNeocloud · Other Nvidia GPUs Sesterce 🇫🇷 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud · Other Nvidia GPUs

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.