News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inference
EveryNeocloud

GPU virtual machines

GPU instances by the hour. 96 providers on EveryNeocloud so far.

A GPU virtual machine (VM) is a slice of a server, with one or more GPUs attached, that a customer can start in minutes and pay for by the hour or second. It is the standard way clouds sell compute. AWS EC2, Google Compute Engine and Azure virtual machines offer GPU types from small inference cards to eight-GPU H100 and Blackwell machines.

How it works

A hypervisor divides the server and passes GPUs straight through to each virtual machine, so performance is close to bare metal. Customers choose an instance type, a fixed mix of GPUs, CPUs, memory and storage, and can stop it when done. Some GPUs can be split further: Nvidia's Multi-Instance GPU cuts one chip into up to seven parts, so small jobs pay less.

Prices and limits

On-demand prices are the highest; reserved instances, committed for one to three years, cost less; spot instances, spare capacity that can be taken back, cost least. In 2023 and 2024 the largest GPU instances were often sold out, and clouds asked customers to reserve ahead. As supply grew in 2025, hourly prices for H100 machines fell across most providers.

Famous GPU virtual machines providers

Further reading

馃嚚馃嚦 ChinaBaidu Chinese search and AI group with its own cloud, chips and foundation modelsHyperscaler 路 Other and custom chips 路 2000 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 馃嚭馃嚫 United States and 1 moreAmazon Elastic Compute Cloud AWS service for renting virtual servers by the secondHyperscaler 路 Other Nvidia GPUs 路 2006 馃嚫馃嚞 Singapore and 2 moreSingtel Singapore telecom group offering AI cloud services and data centre capacityHyperscaler 路 1879 Tencent Cloud 馃嚚馃嚦 China and 4 moreTencent Cloud Tencent's global cloud arm: 66 availability zones, 700+ services, AI and media toolsHyperscaler 路 2013 Oracle Cloud 馃嚭馃嚫 United States and 4 moreOracle Cloud Oracle's global cloud for servers, storage, databases and GPU computeHyperscaler 路 Other Nvidia GPUs 路 2016 馃嚭馃嚫 United States and 2 moreAmazon Web Services Amazon's on-demand cloud platform, offering compute, storage and AI infrastructure worldwideHyperscaler 路 Other Nvidia GPUs 路 2006 Google Compute Engine 馃嚭馃嚫 United StatesGoogle Compute Engine Google's infrastructure-as-a-service for launching virtual machines on demandHyperscaler 路 2012 IBM Cloud 馃嚭馃嚫 United States and 3 moreIBM Cloud IBM's hybrid cloud platform spanning data centres, bare metal and managed KubernetesHyperscaler 馃嚭馃嚫 United States and 4 moreGoogle data centers Hyperscale campuses running Search, YouTube, Gemini and Google Cloud AI workloadsHyperscaler 路 Google TPU 馃嚠馃嚦 IndiaJio Platforms Reliance's holding group for Jio telecom, apps, cloud and AI servicesHyperscaler 路 2019 馃嚚馃嚦 China and 4 moreAlibaba Cloud China's largest cloud provider, running global data centres and the Qwen modelsHyperscaler 路 Other and custom chips 路 2009 Nscale 馃嚞馃嚙 United KingdomNscale UK-based GPU cloud provider and data centre operator founded in 2024.Neocloud 路 Other Nvidia GPUs 路 2024 Azure 馃嚭馃嚫 United StatesAzure Microsoft's global cloud computing platform for infrastructure and AI services.Hyperscaler 路 Nvidia Ampere 路 2010 T Cloud Public 馃嚛馃嚜 Germany and 2 moreT Cloud Public Deutsche Telekom's OpenStack-based infrastructure-as-a-service cloud, run by T-Systems.Hyperscaler 路 2016 Yandex Cloud 馃嚪馃嚭 RussiaYandex Cloud Yandex's public cloud, offering compute, data and ML services to Russian businessesHyperscaler 路 Other Nvidia GPUs 路 2018 Schwarz Digits 馃嚛馃嚜 Germany and 1 moreSchwarz Digits German retail group's IT arm running the STACKIT sovereign cloudSovereign cloud 路 2023 NHN Cloud 馃嚢馃嚪 South KoreaNHN Cloud South Korean cloud provider with large GPU clusters for AI trainingNeocloud 路 Nvidia Blackwell E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.