News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to Nvidia
EveryNeocloud

GPU marketplaces

Vast.ai, SF Compute, the GPU exchanges and the decentralised compute networks. 28 providers on EveryNeocloud so far.

GPU marketplaces match buyers of compute with many sellers instead of owning the hardware themselves. Some, such as Vast.ai and SF Compute, let data centres and owners list spare GPUs at prices that change with demand. Others are decentralised networks, such as Akash, Render and io.net, that pay suppliers in crypto tokens. Routers for model APIs, such as OpenRouter, apply the same idea to inference.

How the market works

GPU time is perishable: an idle hour cannot be sold later. Marketplaces let owners sell spare hours and let buyers bid for them, often at a discount to fixed prices. AWS introduced spot instances, spare capacity sold at a floating price that can be taken back at short notice, in 2009. Rackspace runs an auction for servers and GPUs called Rackspace Spot. SF Compute sells short, reserved blocks of large clusters that buyers can resell.

Trade-offs

Marketplace GPUs can be much cheaper, but quality varies. Machines may sit in different places with slow links between them, so they suit single-server jobs, tuning and inference better than large training runs. Decentralised networks add questions about security and about whether token rewards, rather than real demand, drive supply. Several firms now publish GPU price indices drawn from these markets, giving the industry a view of rental prices.

Famous marketplace providers

Further reading

Hivenet 馃嚚馃嚟 Switzerland and 1 moreHivenet Swiss distributed cloud using crowdsourced storage and GPU capacityNeocloud 路 2022 SF Compute 馃嚭馃嚫 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud 路 Other Nvidia GPUs Aethir WorldAethir Distributed cloud GPU network for AI and gamingMarketplace 路 Other Nvidia GPUs NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace 路 Other Nvidia GPUs Inference.net 馃嚭馃嚫 United StatesInference.net Marketplace for low-cost AI inference via unused GPU capacityInference platform TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper Vast.ai 馃嚭馃嚫 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016 Hyperbolic 馃嚭馃嚫 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace 路 Nvidia Hopper Compute Exchange 馃嚭馃嚫 United StatesCompute Exchange Marketplace for buying and selling GPU compute capacity and hardware.Marketplace 路 Nvidia Hopper Render Network WorldRender Network Decentralised GPU network for rendering and AI computeMarketplace 路 Other Nvidia GPUs Nosana WorldNosana Decentralised marketplace for on-demand GPU computeMarketplace 路 Other Nvidia GPUs Io.net WorldIo.net Decentralised network for GPU computeMarketplace 路 Other Nvidia GPUs 路 2023 Spheron Network WorldSpheron Network Marketplace for renting enterprise NVIDIA and AMD GPUsMarketplace 路 Nvidia Blackwell SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 Clore.ai WorldClore.ai Decentralised marketplace for renting NVIDIA GPUsMarketplace 路 Other Nvidia GPUs Lium 馃嚢馃嚦 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace 路 Nvidia Blackwell Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs Theta EdgeCloud WorldTheta EdgeCloud Distributed GPU network for AI inference and agentsNeocloud 路 Nvidia Hopper Phala Cloud 馃嚭馃嚫 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper Ornn WorldOrnn Marketplace for buying and trading GPU compute capacityMarketplace 路 Nvidia Hopper Kinesis Network 馃嚭馃嚫 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud 路 Nvidia Hopper Nvidia DGX Cloud Lepton 馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs Golem Network 馃嚚馃嚟 SwitzerlandGolem Network Decentralized marketplace for GPU and CPU computeMarketplace 路 Other Nvidia GPUs 路 2016 Shadeform 馃嚭馃嚫 United StatesShadeform Marketplace for GPU cloud access across multiple providersMarketplace 路 Other Nvidia GPUs Fluence 馃嚚馃嚟 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud 路 Other Nvidia GPUs 路 2017 Mithril 馃嚭馃嚫 United StatesMithril A GPU VM marketplace with spot bids and flexible reservations for AI workloadsMarketplace Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.