News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to Nvidia
EveryNeocloud

Other Nvidia GPUs

L40S, RTX and earlier Volta and Pascal cards. 113 providers on EveryNeocloud so far.

Beyond its flagship data centre chips, Nvidia sells many other GPUs that clouds rent out: the L40S and L4 of the Ada Lovelace generation, RTX workstation and gaming cards, the T4 for inference, and older data centre parts such as the Volta V100 of 2017 and the Pascal P100 of 2016. These cards fill the long tail of AI work, where a single cheaper GPU is enough.

The older generations

The P100 of 2016 brought high-bandwidth memory to Nvidia GPUs, and the V100 of 2017 introduced Tensor Cores, units built for the matrix maths of neural networks. The V100 powered Summit and Sierra in the US, Taiwania 2 and Japan's first ABCI. Earlier still, Titan at Oak Ridge used Kepler GPUs in 2012, one of the first large bets on GPUs for science.

Cards for inference and graphics

The L40S, launched in 2023, has 48 GB of memory and handles both AI inference and 3D graphics, and the small, low-power L4 suits video and light inference. Developer clouds such as Vultr and DigitalOcean rent these by the hour. Marketplaces also list many consumer RTX cards, such as the RTX 4090, which are cheap but lack the memory and fast links of data centre GPUs.

Famous other Nvidia GPUs providers

Still to be written: Vultr.

Further reading

Highreso 馃嚡馃嚨 JapanHighreso Japanese GPU cloud operator running its own GPU-only data centresNeocloud 路 Other Nvidia GPUs Ubitus 馃嚡馃嚨 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud 路 Other Nvidia GPUs 路 2012 Sesterce 馃嚝馃嚪 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud 路 Other Nvidia GPUs Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell Fal 馃嚭馃嚫 United StatesFal Serverless GPU platform for generative AI inferenceInference platform 路 Other Nvidia GPUs 路 2021 Anyscale 馃嚭馃嚫 United States and 1 moreAnyscale Managed Ray platform for distributed AI workloadsDeveloper cloud 路 Other Nvidia GPUs Novita AI 馃嚭馃嚫 United StatesNovita AI AI cloud platform offering model APIs and GPU instances for developers.Neocloud 路 Other Nvidia GPUs Modal 馃嚭馃嚫 United States and 1 moreModal Serverless cloud platform for AI development and inferenceDeveloper cloud 路 Other Nvidia GPUs DeepInfra 馃嚭馃嚫 United StatesDeepInfra Inference cloud for open-source AI modelsInference platform 路 Nvidia Blackwell 路 2022 PPIO 馃嚚馃嚦 ChinaPPIO Independent AI cloud for agent infrastructure and GPU computeNeocloud 路 Other Nvidia GPUs 路 2018 Fireworks AI 馃嚭馃嚫 United StatesFireworks AI Platform for running and training open AI modelsInference platform 路 Other Nvidia GPUs Runware 馃嚭馃嚫 United StatesRunware Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023 Koyeb 馃嚝馃嚪 FranceKoyeb Serverless cloud platform for AI inference and applicationsNeocloud 路 Other Nvidia GPUs 路 2021 Siam AI 馃嚬馃嚟 ThailandSiam AI GPU cloud provider based in Thailand for enterprise workloadsNeocloud 路 Other Nvidia GPUs RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell Saturn Cloud 馃嚭馃嚫 United StatesSaturn Cloud Managed inference platform for open AI models on dedicated GPUsInference platform 路 Other Nvidia GPUs Lightning AI 馃嚭馃嚫 United StatesLightning AI AI cloud platform with owned GPU infrastructureNeocloud 路 Other Nvidia GPUs 路 2026 Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011 Hostkey 馃嚦馃嚤 Netherlands and 3 moreHostkey Dedicated GPU and bare-metal server provider in Europe and the USNeocloud 路 Other Nvidia GPUs 路 2007 Hivelocity 馃嚭馃嚫 United StatesHivelocity Bare metal and GPU infrastructure for AI workloadsNeocloud 路 Other Nvidia GPUs TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper Vast.ai 馃嚭馃嚫 United StatesVast.ai Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016 GPU Mart 馃嚭馃嚫 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud 路 Nvidia Blackwell 路 2021 Render Network WorldRender Network Decentralised GPU network for rendering and AI computeMarketplace 路 Other Nvidia GPUs Nosana WorldNosana Decentralised marketplace for on-demand GPU computeMarketplace 路 Other Nvidia GPUs Io.net WorldIo.net Decentralised network for GPU computeMarketplace 路 Other Nvidia GPUs 路 2023 SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 Clore.ai WorldClore.ai Decentralised marketplace for renting NVIDIA GPUsMarketplace 路 Other Nvidia GPUs Lium 馃嚢馃嚦 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace 路 Nvidia Blackwell Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs Kinesis Network 馃嚭馃嚫 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud 路 Nvidia Hopper DigiPowerX 馃嚭馃嚫 United StatesDigiPowerX Vertically integrated AI infrastructure with owned power and GPU compute.Neocloud 路 Nvidia Blackwell Nvidia DGX Cloud Lepton 馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Doudna 馃嚭馃嚫 United StatesDoudna US Department of Energy supercomputer for AI and scienceSupercomputer 路 Other Nvidia GPUs 路 2026 Nvidia DGX Cloud 馃嚭馃嚫 United StatesNvidia DGX Cloud Nvidia's internal cloud for AI development and operationsHyperscaler 路 Other Nvidia GPUs Ionstream 馃嚭馃嚫 United StatesIonstream Bare-metal NVIDIA GPU servers with automated provisioning and optimised networkingNeocloud 路 Other Nvidia GPUs EuroHPC AI Factories EuropeEuroHPC AI Factories Pan-European network of AI-optimised supercomputing hubsSovereign cloud 路 Other Nvidia GPUs 路 2024 AIRAWAT 馃嚠馃嚦 IndiaAIRAWAT India's national AI supercomputer for research and public welfareSupercomputer 路 Other Nvidia GPUs 路 2023 Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper Dawn 馃嚞馃嚙 United KingdomDawn UK national AI supercomputer for research and industrySupercomputer 路 Other Nvidia GPUs ESDS 馃嚠馃嚦 IndiaESDS Indian-owned cloud and data centre provider with AI infrastructure.Neocloud 路 Other Nvidia GPUs 路 2005 Hyperstack 馃嚞馃嚙 United Kingdom and 4 moreHyperstack Self-serve GPU cloud from UK-owned NexGen Cloud, sold as HyperstackNeocloud 路 Other Nvidia GPUs 路 2020 RackBank 馃嚠馃嚦 IndiaRackBank AI data centre provider in India offering bare metal GPU hosting.Neocloud 路 Other Nvidia GPUs Latitude.sh 馃嚭馃嚫 United StatesLatitude.sh Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs Firmus 馃嚘馃嚭 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud 路 Nvidia Blackwell Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper Oblivus WorldOblivus On-demand and reserved GPU cloud for training, inference and renderingNeocloud 路 Other Nvidia GPUs

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.