News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to Nvidia
EveryNeocloud

Other Nvidia GPUs

L40S, RTX and earlier Volta and Pascal cards. 113 providers on EveryNeocloud so far.

Beyond its flagship data centre chips, Nvidia sells many other GPUs that clouds rent out: the L40S and L4 of the Ada Lovelace generation, RTX workstation and gaming cards, the T4 for inference, and older data centre parts such as the Volta V100 of 2017 and the Pascal P100 of 2016. These cards fill the long tail of AI work, where a single cheaper GPU is enough.

The older generations

The P100 of 2016 brought high-bandwidth memory to Nvidia GPUs, and the V100 of 2017 introduced Tensor Cores, units built for the matrix maths of neural networks. The V100 powered Summit and Sierra in the US, Taiwania 2 and Japan's first ABCI. Earlier still, Titan at Oak Ridge used Kepler GPUs in 2012, one of the first large bets on GPUs for science.

Cards for inference and graphics

The L40S, launched in 2023, has 48 GB of memory and handles both AI inference and 3D graphics, and the small, low-power L4 suits video and light inference. Developer clouds such as Vultr and DigitalOcean rent these by the hour. Marketplaces also list many consumer RTX cards, such as the RTX 4090, which are cheap but lack the memory and fast links of data centre GPUs.

Famous other Nvidia GPUs providers

Still to be written: Vultr.

Further reading

馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 IREN 馃嚘馃嚭 Australia and 2 moreIREN Australian GPU cloud and data centre operator for AI workloadsNeocloud 路 Other Nvidia GPUs 路 2018 馃嚥馃嚲 Malaysia and 4 moreYTL Corporation Malaysian infrastructure group running AI data centres and Nvidia cloud capacityNeocloud 路 Other Nvidia GPUs 路 1955 Nebius Group 馃嚦馃嚤 Netherlands and 2 moreNebius Group AI infrastructure company offering GPU cloud services, listed on Nasdaq.Neocloud 路 Other Nvidia GPUs 路 2004 Pittsburgh Supercomputing Cent 馃嚭馃嚫 United StatesPittsburgh Supercomputing Center Joint Carnegie Mellon and Pittsburgh university centre for research computing and networkingResearch cluster 路 Other Nvidia GPUs 路 1986 馃嚭馃嚫 United StatesTexas Advanced Computing Center University of Texas centre running supercomputers and storage for U.S. researchResearch cluster 路 Other Nvidia GPUs 路 2001 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 Nscale 馃嚞馃嚙 United KingdomNscale UK-based GPU cloud provider and data centre operator founded in 2024.Neocloud 路 Other Nvidia GPUs 路 2024 馃嚛馃嚜 Germany and 4 moreDeutsche Telekom German telecoms group building industrial AI cloud infrastructure with NvidiaHyperscaler 路 Other Nvidia GPUs 路 1995 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 Oracle Cloud 馃嚭馃嚫 United States and 4 moreOracle Cloud Oracle's global cloud for servers, storage, databases and GPU computeHyperscaler 路 Other Nvidia GPUs 路 2016 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 Soluna 馃嚭馃嚫 United StatesSoluna Renewable energy-powered AI and Bitcoin cloudNeocloud 路 Other Nvidia GPUs Ubitus 馃嚡馃嚨 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud 路 Other Nvidia GPUs 路 2012 Sesterce 馃嚝馃嚪 France and 2 moreSesterce European builder of dedicated bare-metal GPU supercomputers on its own campusesNeocloud 路 Other Nvidia GPUs Saturn Cloud 馃嚭馃嚫 United StatesSaturn Cloud Managed inference platform for open AI models on dedicated GPUsInference platform 路 Other Nvidia GPUs Exoscale 馃嚚馃嚟 Switzerland and 4 moreExoscale European cloud provider for developers and AI workloadsNeocloud 路 Other Nvidia GPUs 路 2011 Hostkey 馃嚦馃嚤 Netherlands and 3 moreHostkey Dedicated GPU and bare-metal server provider in Europe and the USNeocloud 路 Other Nvidia GPUs 路 2007 Hivelocity 馃嚭馃嚫 United StatesHivelocity Bare metal and GPU infrastructure for AI workloadsNeocloud 路 Other Nvidia GPUs Kinesis Network 馃嚭馃嚫 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud 路 Nvidia Hopper DigiPowerX 馃嚭馃嚫 United StatesDigiPowerX Vertically integrated AI infrastructure with owned power and GPU compute.Neocloud 路 Nvidia Blackwell ESDS 馃嚠馃嚦 IndiaESDS Indian-owned cloud and data centre provider with AI infrastructure.Neocloud 路 Other Nvidia GPUs 路 2005 RackBank 馃嚠馃嚦 IndiaRackBank AI data centre provider in India offering bare metal GPU hosting.Neocloud 路 Other Nvidia GPUs Firmus 馃嚘馃嚭 Australia and 2 moreFirmus Neocloud operator building immersion-cooled AI Factories across Asia-PacificNeocloud 路 Nvidia Blackwell Seeweb 馃嚠馃嚬 ItalySeeweb European cloud provider with GPU and Kubernetes servicesNeocloud 路 Other Nvidia GPUs NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace 路 Other Nvidia GPUs HIVE Digital Technologies 馃嚚馃嚘 Canada and 2 moreHIVE Digital Technologies Clean-energy data centres for crypto mining and AI computeFormer miner 路 Other Nvidia GPUs 路 2017 Core42 馃嚘馃嚜 United Arab EmiratesCore42 Sovereign AI cloud and infrastructure provider based in the UAE.Sovereign cloud 路 Other Nvidia GPUs Simplismart 馃嚠馃嚦 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.