News
MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)
EveryNeocloud

Bare-metal GPUs

Whole servers, with no virtual layer. 87 providers on EveryNeocloud so far.

A bare-metal GPU server is a whole physical machine rented to one customer, with no hypervisor, the software layer that splits a server into virtual machines. The customer gets every GPU, all the memory and direct access to the network cards. Neoclouds such as CoreWeave built their business on bare metal, and hosts such as Hetzner, OVHcloud and Leaseweb have long rented dedicated servers.

Why AI teams want it

Large training jobs need every bit of speed, and a virtual layer can slow the links between GPUs and to the network. On bare metal, GPUs talk to each other through NVLink and to other servers through InfiniBand or RoCE, a fast Ethernet method, with nothing in between. Teams can also install their own drivers and tools. The trade-off is that the customer manages more of the system.

How it is sold

Bare-metal GPU servers are usually rented by the month or on reserved contracts, often as eight-GPU nodes. Many providers wrap bare metal in Kubernetes or a job scheduler such as Slurm, so customers get the speed of bare metal with tools to run jobs. Providers compete on how fast they can hand over healthy servers and how they handle failures.

Famous bare-metal GPUs providers

Still to be written: Leaseweb, Vultr.

Further reading

Oracle Cloud 馃嚭馃嚫 United States and 4 moreOracle Cloud Oracle's global cloud for servers, storage, databases and GPU computeHyperscaler 路 Other Nvidia GPUs 路 2016 馃嚭馃嚫 United StatesNCAR-Wyoming Supercomputing Center A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer 路 Other Nvidia GPUs 路 2003 Gcore 馃嚤馃嚭 Luxembourg and 1 moreGcore Luxembourg edge AI, cloud, CDN and security provider with GPU clusters in EuropeNeocloud 路 Other Nvidia GPUs 路 2011 Nscale 馃嚞馃嚙 United KingdomNscale UK-based GPU cloud provider and data centre operator founded in 2024.Neocloud 路 Other Nvidia GPUs 路 2024 馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 Colossus 馃嚭馃嚫 United StatesColossus An AI supercomputer cluster in Tennessee and Mississippi built by xAI.Supercomputer 路 Nvidia Hopper 路 2024 Taiwania 馃嚬馃嚰 TaiwanTaiwania A series of supercomputers in Taiwan for scientific research and public access.Supercomputer 路 Other Nvidia GPUs 路 2018 馃嚭馃嚫 United States and 2 moreAmazon Web Services Amazon's on-demand cloud platform, offering compute, storage and AI infrastructure worldwideHyperscaler 路 Other Nvidia GPUs 路 2006 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 Nebius Group 馃嚦馃嚤 Netherlands and 2 moreNebius Group AI infrastructure company offering GPU cloud services, listed on Nasdaq.Neocloud 路 Other Nvidia GPUs 路 2004 IREN 馃嚘馃嚭 Australia and 2 moreIREN Australian GPU cloud and data centre operator for AI workloadsNeocloud 路 Other Nvidia GPUs 路 2018 馃嚚馃嚟 SwitzerlandAlps Swiss national supercomputer using Nvidia GH200 chips for AI and scientific research.Supercomputer 路 Other Nvidia GPUs 路 2024 馃嚭馃嚫 United States and 1 moreAmazon Elastic Compute Cloud AWS service for renting virtual servers by the secondHyperscaler 路 Other Nvidia GPUs 路 2006 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 Runware 馃嚭馃嚫 United StatesRunware Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023 Siam AI 馃嚬馃嚟 ThailandSiam AI GPU cloud provider based in Thailand for enterprise workloadsNeocloud 路 Other Nvidia GPUs RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell Lightning AI 馃嚭馃嚫 United StatesLightning AI AI cloud platform with owned GPU infrastructureNeocloud 路 Other Nvidia GPUs 路 2026 Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011 Hostkey 馃嚦馃嚤 Netherlands and 3 moreHostkey Dedicated GPU and bare-metal server provider in Europe and the USNeocloud 路 Other Nvidia GPUs 路 2007 Hivelocity 馃嚭馃嚫 United StatesHivelocity Bare metal and GPU infrastructure for AI workloadsNeocloud 路 Other Nvidia GPUs TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper Vast.ai 馃嚭馃嚫 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016 GPU Mart 馃嚭馃嚫 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud 路 Nvidia Blackwell 路 2021 SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 Lium 馃嚢馃嚦 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace 路 Nvidia Blackwell DigiPowerX 馃嚭馃嚫 United StatesDigiPowerX Vertically integrated AI infrastructure with owned power and GPU compute.Neocloud 路 Nvidia Blackwell Ionstream 馃嚭馃嚫 United StatesIonstream Bare-metal NVIDIA GPU servers with automated provisioning and optimised networkingNeocloud 路 Other Nvidia GPUs Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper ESDS 馃嚠馃嚦 IndiaESDS Indian-owned cloud and data centre provider with AI infrastructure.Neocloud 路 Other Nvidia GPUs 路 2005 RackBank 馃嚠馃嚦 IndiaRackBank AI data centre provider in India offering bare metal GPU hosting.Neocloud 路 Other Nvidia GPUs Latitude.sh 馃嚭馃嚫 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs Krutrim Cloud 馃嚠馃嚦 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs Beam WorldBeam Developer cloud for AI agents and GPU workloadsDeveloper cloud 路 Other Nvidia GPUs Soluna 馃嚭馃嚫 United StatesSoluna Renewable energy-powered AI and Bitcoin cloudNeocloud 路 Other Nvidia GPUs Core42 馃嚘馃嚜 United Arab EmiratesCore42 Sovereign AI cloud and infrastructure provider based in the UAE.Sovereign cloud 路 Other Nvidia GPUs Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper Targon 馃嚭馃嚫 United StatesTargon On-demand NVIDIA GPU cloud for training and inferenceNeocloud 路 Other Nvidia GPUs Clore.ai WorldClore.ai Decentralised marketplace for renting NVIDIA GPUsMarketplace 路 Other Nvidia GPUs E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Hyperstack 馃嚞馃嚙 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud 路 Other Nvidia GPUs 路 2020 Firmus 馃嚘馃嚭 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud 路 Nvidia Blackwell SF Compute 馃嚭馃嚫 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud 路 Other Nvidia GPUs Aethir WorldAethir Distributed cloud GPU network for AI and gamingMarketplace 路 Other Nvidia GPUs HIVE Digital Technologies 馃嚚馃嚘 Canada and 2 moreHIVE Digital Technologies Clean-energy data centres for crypto mining and AI computeFormer miner 路 Other Nvidia GPUs 路 2017 Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Voltage Park 馃嚭馃嚫 United StatesVoltage Park US GPU cloud selling on-demand and reserved AI compute from its own hardwareNeocloud 路 Other Nvidia GPUs

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.