News
ClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?
EveryNeocloud

GPU virtual machines

GPU instances by the hour. 96 providers on EveryNeocloud so far.

A GPU virtual machine (VM) is a slice of a server, with one or more GPUs attached, that a customer can start in minutes and pay for by the hour or second. It is the standard way clouds sell compute. AWS EC2, Google Compute Engine and Azure virtual machines offer GPU types from small inference cards to eight-GPU H100 and Blackwell machines.

How it works

A hypervisor divides the server and passes GPUs straight through to each virtual machine, so performance is close to bare metal. Customers choose an instance type, a fixed mix of GPUs, CPUs, memory and storage, and can stop it when done. Some GPUs can be split further: Nvidia's Multi-Instance GPU cuts one chip into up to seven parts, so small jobs pay less.

Prices and limits

On-demand prices are the highest; reserved instances, committed for one to three years, cost less; spot instances, spare capacity that can be taken back, cost least. In 2023 and 2024 the largest GPU instances were often sold out, and clouds asked customers to reserve ahead. As supply grew in 2025, hourly prices for H100 machines fell across most providers.

Famous GPU virtual machines providers

Further reading

Hivenet 🇨🇭 Switzerland and 1 moreHivenet Swiss distributed cloud using crowdsourced storage and GPU capacityNeocloud · 2022 SF Compute 🇺🇸 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud · Other Nvidia GPUs NodeShift 🇬🇧 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace · Other Nvidia GPUs · 2024 Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace · Other Nvidia GPUs TensorDock 🇺🇸 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace · Nvidia Hopper Vast.ai 🇺🇸 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace · Nvidia Blackwell · 2016 Hyperbolic 🇺🇸 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace · Nvidia Hopper Nosana WorldNosana Decentralised marketplace for on-demand GPU computeMarketplace · Other Nvidia GPUs Spheron Network WorldSpheron Network Marketplace for renting enterprise NVIDIA and AMD GPUsMarketplace · Nvidia Blackwell SaladCloud 🇺🇸 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud · Other Nvidia GPUs · 2018 Lium 🇰🇳 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace · Nvidia Blackwell Theta EdgeCloud WorldTheta EdgeCloud Distributed GPU network for AI inference and agentsNeocloud · Nvidia Hopper Phala Cloud 🇺🇸 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud · Nvidia Hopper Kinesis Network 🇺🇸 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud · Nvidia Hopper Shadeform 🇺🇸 United StatesShadeform Marketplace for GPU cloud access across multiple providersMarketplace · Other Nvidia GPUs Fluence 🇨🇭 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud · Other Nvidia GPUs · 2017 Mithril 🇺🇸 United StatesMithril A GPU VM marketplace with spot bids and flexible reservations for AI workloadsMarketplace Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace · Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

  • Amazon Elastic Compute Cloud: Raysonho @ Open Grid Scheduler / Grid Engine, CC BY-SA 3.0, source

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.