GPU virtual machines
GPU instances by the hour. 96 providers on EveryNeocloud so far.
A GPU virtual machine (VM) is a slice of a server, with one or more GPUs attached, that a customer can start in minutes and pay for by the hour or second. It is the standard way clouds sell compute. AWS EC2, Google Compute Engine and Azure virtual machines offer GPU types from small inference cards to eight-GPU H100 and Blackwell machines.
How it works
A hypervisor divides the server and passes GPUs straight through to each virtual machine, so performance is close to bare metal. Customers choose an instance type, a fixed mix of GPUs, CPUs, memory and storage, and can stop it when done. Some GPUs can be split further: Nvidia's Multi-Instance GPU cuts one chip into up to seven parts, so small jobs pay less.
Prices and limits
On-demand prices are the highest; reserved instances, committed for one to three years, cost less; spot instances, spare capacity that can be taken back, cost least. In 2023 and 2024 the largest GPU instances were often sold out, and clouds asked customers to reserve ahead. As supply grew in 2025, hourly prices for H100 machines fell across most providers.
Famous GPU virtual machines providers
Further reading
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Cloudflare: HaeB, CC BY-SA 4.0, source
- Amazon Web Services: Raysonho @ Open Grid Scheduler / Grid Engine, CC0, source
- Yandex Cloud: WikiFido, CC BY-SA 4.0, source
- Amazon Elastic Compute Cloud: Raysonho @ Open Grid Scheduler / Grid Engine, CC BY-SA 3.0, source