GPU virtual machines
GPU instances by the hour. 96 providers on EveryNeocloud so far.
A GPU virtual machine (VM) is a slice of a server, with one or more GPUs attached, that a customer can start in minutes and pay for by the hour or second. It is the standard way clouds sell compute. AWS EC2, Google Compute Engine and Azure virtual machines offer GPU types from small inference cards to eight-GPU H100 and Blackwell machines.
How it works
A hypervisor divides the server and passes GPUs straight through to each virtual machine, so performance is close to bare metal. Customers choose an instance type, a fixed mix of GPUs, CPUs, memory and storage, and can stop it when done. Some GPUs can be split further: Nvidia's Multi-Instance GPU cuts one chip into up to seven parts, so small jobs pay less.
Prices and limits
On-demand prices are the highest; reserved instances, committed for one to three years, cost less; spot instances, spare capacity that can be taken back, cost least. In 2023 and 2024 the largest GPU instances were often sold out, and clouds asked customers to reserve ahead. As supply grew in 2025, hourly prices for H100 machines fell across most providers.
Famous GPU virtual machines providers
Further reading
馃嚥馃嚲 Malaysia and 4 moreYTL AI Cloud
Malaysian AI cloud and supercomputer run from a solar-backed Johor data centre parkNeocloud 路 Nvidia Blackwell 路 2024
馃嚢馃嚪 South KoreaNHN Cloud
South Korean cloud provider with large GPU clusters for AI trainingNeocloud 路 Nvidia Blackwell
馃嚭馃嚫 United StatesWhiteFiber
AI data centres, private GPU clouds and reserved GPU capacity in North AmericaNeocloud 路 Nvidia Blackwell
馃嚭馃嚫 United StatesTogether AI
AI cloud running open models on demand, with GPU clusters and inference researchNeocloud 路 Nvidia Blackwell
馃嚝馃嚠 FinlandVerda
European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell
馃嚭馃嚫 United StatesRunPod
AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell
馃嚠馃嚦 IndiaE2E Networks
India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- YTL AI Cloud: YTL Power International Berhad, CC BY-SA 4.0, source
- Amazon Elastic Compute Cloud: Raysonho @ Open Grid Scheduler / Grid Engine, CC BY-SA 3.0, source