News
SovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignSovereign AI: Africa Is Buying The Chips, Not The RulesMinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealInferenceIndia Startup Sells DeepSeek Access While Pursuing Sovereign AIClustersLumen鈥檚 Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignSovereign AI: Africa Is Buying The Chips, Not The RulesMinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealInferenceIndia Startup Sells DeepSeek Access While Pursuing Sovereign AIClustersLumen鈥檚 Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box win
EveryNeocloud

Bare-metal GPUs

Whole servers, with no virtual layer. 88 providers on EveryNeocloud so far.

A bare-metal GPU server is a whole physical machine rented to one customer, with no hypervisor, the software layer that splits a server into virtual machines. The customer gets every GPU, all the memory and direct access to the network cards. Neoclouds such as CoreWeave built their business on bare metal, and hosts such as Hetzner, OVHcloud and Leaseweb have long rented dedicated servers.

Why AI teams want it

Large training jobs need every bit of speed, and a virtual layer can slow the links between GPUs and to the network. On bare metal, GPUs talk to each other through NVLink and to other servers through InfiniBand or RoCE, a fast Ethernet method, with nothing in between. Teams can also install their own drivers and tools. The trade-off is that the customer manages more of the system.

How it is sold

Bare-metal GPU servers are usually rented by the month or on reserved contracts, often as eight-GPU nodes. Many providers wrap bare metal in Kubernetes or a job scheduler such as Slurm, so customers get the speed of bare metal with tools to run jobs. Providers compete on how fast they can hand over healthy servers and how they handle failures.

Famous bare-metal GPUs providers

Still to be written: Leaseweb, Vultr.

Further reading

馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 Hetzner Online 馃嚛馃嚜 Germany and 3 moreHetzner Online German data centre operator selling servers, colocation and cloud capacityNeocloud 路 1997 Humain 馃嚫馃嚘 Saudi ArabiaHumain Saudi AI infrastructure provider and ALLaM model developer backed by PIF and Aramco.Sovereign cloud 路 Other Nvidia GPUs 路 2025 馃嚭馃嚫 United StatesCerebras Developer of wafer-scale AI chips and supercomputers for inference and training.Neocloud 路 Cerebras wafer-scale 路 2016 Nebius Group 馃嚦馃嚤 Netherlands and 2 moreNebius Group AI infrastructure company offering GPU cloud services, listed on Nasdaq.Neocloud 路 Other Nvidia GPUs 路 2004 馃嚝馃嚪 FranceOVHcloud French cloud and hosting provider running its own servers and data centresNeocloud 路 1999 Gcore 馃嚤馃嚭 Luxembourg and 1 moreGcore Luxembourg edge AI, cloud, CDN and security provider with GPU clusters in EuropeNeocloud 路 Other Nvidia GPUs 路 2011 馃嚝馃嚪 FranceScaleway French cloud and hosting provider owned by Iliad, offering dedicated servers and sovereign AI infrastructure.Neocloud 路 2000 SambaNova Systems 馃嚭馃嚫 United StatesSambaNova Systems American provider of custom AI silicon and cloud inference services based on Reconfigurable Dataflow Units.Neocloud 路 Other and custom chips 路 2017 Ionos 馃嚛馃嚜 Germany and 2 moreIonos German web hosting and cloud computing provider, part of United InternetNeocloud 路 1988 馃嚠馃嚬 Italy and 3 moreAruba Italian data centre and cloud provider running its own campuses across Italy and EuropeNeocloud 路 1994 IREN 馃嚘馃嚭 Australia and 2 moreIREN Australian GPU cloud and data centre operator for AI workloadsNeocloud 路 Other Nvidia GPUs 路 2018 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 Nscale 馃嚞馃嚙 United KingdomNscale UK-based GPU cloud provider and data centre operator founded in 2024.Neocloud 路 Other Nvidia GPUs 路 2024 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 TensorWave WorldTensorWave AMD-exclusive AI cloud for training and running large modelsNeocloud 路 AMD Instinct Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Chutes WorldChutes Serverless, decentralised compute for running open-source AI models in productionInference platform Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell Radiant 馃嚞馃嚙 United KingdomRadiant AI compute infrastructure company building repeatable 'AI factories' powered by its FlightDeck platform.Neocloud 路 Nvidia Blackwell CUDO Compute 馃嚞馃嚙 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud 路 Nvidia Hopper Massed Compute 馃嚭馃嚫 United StatesMassed Compute GPU cloud with per-second pricing and no bandwidth billingNeocloud Highreso 馃嚡馃嚨 JapanHighreso Japanese GPU cloud operator running its own GPU-only data centresNeocloud 路 Other Nvidia GPUs Applied Digital 馃嚭馃嚫 United StatesApplied Digital Builder and operator of large-scale AI data centresNeocloud 路 2021 Sesterce 馃嚝馃嚪 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud 路 Other Nvidia GPUs Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell Novita AI 馃嚭馃嚫 United StatesNovita AI AI cloud platform offering model APIs and GPU instances for developers.Neocloud 路 Other Nvidia GPUs Runware 馃嚭馃嚫 United StatesRunware Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023 Siam AI 馃嚬馃嚟 ThailandSiam AI GPU cloud provider based in Thailand for enterprise workloadsNeocloud 路 Other Nvidia GPUs Lightning AI 馃嚭馃嚫 United StatesLightning AI AI cloud platform with owned GPU infrastructureNeocloud 路 Other Nvidia GPUs 路 2026 Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011 Zenlayer 馃嚭馃嚫 United StatesZenlayer Distributed cloud infrastructure for global AI inferenceNeocloud 路 2014 Hostkey 馃嚦馃嚤 Netherlands and 3 moreHostkey Dedicated GPU and bare-metal server provider in Europe and the USNeocloud 路 Other Nvidia GPUs 路 2007 Hivelocity 馃嚭馃嚫 United StatesHivelocity Bare metal and GPU infrastructure for AI workloadsNeocloud 路 Other Nvidia GPUs TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper Vast.ai 馃嚭馃嚫 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016 GPU Mart 馃嚭馃嚫 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud 路 Nvidia Blackwell 路 2021 Hyperbolic 馃嚭馃嚫 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace 路 Nvidia Hopper RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 Lambda 馃嚭馃嚫 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012 Phala Cloud 馃嚭馃嚫 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper DigiPowerX 馃嚭馃嚫 United StatesDigiPowerX Vertically integrated AI infrastructure with owned power and GPU compute.Neocloud 路 Nvidia Blackwell Bitzero 馃嚦馃嚧 Norway and 1 moreBitzero Nordic AI data centre operator with over 1 GW of power capacity.Neocloud Ionstream 馃嚭馃嚫 United StatesIonstream Bare-metal NVIDIA GPU servers with automated provisioning and optimised networkingNeocloud 路 Other Nvidia GPUs Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper RackBank 馃嚠馃嚦 IndiaRackBank AI data centre provider in India offering bare metal GPU hosting.Neocloud 路 Other Nvidia GPUs

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.