News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Other Nvidia GPUs

L40S, RTX and earlier Volta and Pascal cards. 113 providers on EveryNeocloud so far.

Beyond its flagship data centre chips, Nvidia sells many other GPUs that clouds rent out: the L40S and L4 of the Ada Lovelace generation, RTX workstation and gaming cards, the T4 for inference, and older data centre parts such as the Volta V100 of 2017 and the Pascal P100 of 2016. These cards fill the long tail of AI work, where a single cheaper GPU is enough.

The older generations

The P100 of 2016 brought high-bandwidth memory to Nvidia GPUs, and the V100 of 2017 introduced Tensor Cores, units built for the matrix maths of neural networks. The V100 powered Summit and Sierra in the US, Taiwania 2 and Japan's first ABCI. Earlier still, Titan at Oak Ridge used Kepler GPUs in 2012, one of the first large bets on GPUs for science.

Cards for inference and graphics

The L40S, launched in 2023, has 48 GB of memory and handles both AI inference and 3D graphics, and the small, low-power L4 suits video and light inference. Developer clouds such as Vultr and DigitalOcean rent these by the hour. Marketplaces also list many consumer RTX cards, such as the RTX 4090, which are cheap but lack the memory and fast links of data centre GPUs.

Famous other Nvidia GPUs providers

Still to be written: Vultr.

Further reading

馃嚭馃嚫 United StatesCloudflare Edge network running Nvidia GPUs for AI inference via Workers AIInference platform 路 Other Nvidia GPUs 路 2009 Humain 馃嚫馃嚘 Saudi ArabiaHumain Saudi AI company building data centres, cloud services and Arabic modelsNeocloud 路 Other Nvidia GPUs 路 2025 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 Yandex Cloud 馃嚪馃嚭 RussiaYandex Cloud Yandex's public cloud, offering compute, data and ML services to Russian businessesHyperscaler 路 Other Nvidia GPUs 路 2018 Fal 馃嚭馃嚫 United StatesFal Serverless GPU platform for generative AI inferenceInference platform 路 Other Nvidia GPUs 路 2021 Novita AI 馃嚭馃嚫 United StatesNovita AI AI cloud platform offering model APIs and GPU instances for developers.Neocloud 路 Other Nvidia GPUs DeepInfra 馃嚭馃嚫 United StatesDeepInfra Inference cloud for open-source AI modelsInference platform 路 Nvidia Blackwell 路 2022 PPIO 馃嚚馃嚦 ChinaPPIO Independent AI cloud for agent infrastructure and GPU computeNeocloud 路 Other Nvidia GPUs 路 2018 Fireworks AI 馃嚭馃嚫 United StatesFireworks AI Platform for running and training open AI modelsInference platform 路 Other Nvidia GPUs Runware 馃嚭馃嚫 United StatesRunware Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023 Saturn Cloud 馃嚭馃嚫 United StatesSaturn Cloud Managed inference platform for open AI models on dedicated GPUsInference platform 路 Other Nvidia GPUs SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs Nvidia DGX Cloud Lepton 馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs Inferless 馃嚭馃嚫 United StatesInferless Serverless GPU inference platform for custom modelsInference platform 路 Other Nvidia GPUs Golem Network 馃嚚馃嚟 SwitzerlandGolem Network Decentralized marketplace for GPU and CPU computeMarketplace 路 Other Nvidia GPUs 路 2016 FriendliAI 馃嚢馃嚪 South KoreaFriendliAI Accelerated generative AI inference serving platformInference platform 路 Other Nvidia GPUs E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Simplismart 馃嚠馃嚦 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell Oblivus WorldOblivus On-demand and reserved GPU cloud for training, inference and renderingNeocloud 路 Other Nvidia GPUs Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Jarvislabs 馃嚠馃嚦 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper Ubitus 馃嚡馃嚨 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud 路 Other Nvidia GPUs 路 2012

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.