News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inference
EveryNeocloud

Other Nvidia GPUs

L40S, RTX and earlier Volta and Pascal cards. 113 providers on EveryNeocloud so far.

Beyond its flagship data centre chips, Nvidia sells many other GPUs that clouds rent out: the L40S and L4 of the Ada Lovelace generation, RTX workstation and gaming cards, the T4 for inference, and older data centre parts such as the Volta V100 of 2017 and the Pascal P100 of 2016. These cards fill the long tail of AI work, where a single cheaper GPU is enough.

The older generations

The P100 of 2016 brought high-bandwidth memory to Nvidia GPUs, and the V100 of 2017 introduced Tensor Cores, units built for the matrix maths of neural networks. The V100 powered Summit and Sierra in the US, Taiwania 2 and Japan's first ABCI. Earlier still, Titan at Oak Ridge used Kepler GPUs in 2012, one of the first large bets on GPUs for science.

Cards for inference and graphics

The L40S, launched in 2023, has 48 GB of memory and handles both AI inference and 3D graphics, and the small, low-power L4 suits video and light inference. Developer clouds such as Vultr and DigitalOcean rent these by the hour. Marketplaces also list many consumer RTX cards, such as the RTX 4090, which are cheap but lack the memory and fast links of data centre GPUs.

Famous other Nvidia GPUs providers

Still to be written: Vultr.

Further reading

Soluna 馃嚭馃嚫 United StatesSoluna Renewable energy-powered AI and Bitcoin cloudNeocloud 路 Other Nvidia GPUs Simplismart 馃嚠馃嚦 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell Inferless 馃嚭馃嚫 United StatesInferless Serverless GPU inference platform for custom modelsInference platform 路 Other Nvidia GPUs Blue Lion 馃嚛馃嚜 GermanyBlue Lion German supercomputer for AI and climate scienceSupercomputer 路 Other Nvidia GPUs 路 2027 Golem Network 馃嚚馃嚟 SwitzerlandGolem Network Decentralized marketplace for GPU and CPU computeMarketplace 路 Other Nvidia GPUs 路 2016 SF Compute 馃嚭馃嚫 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud 路 Other Nvidia GPUs Seeweb 馃嚠馃嚬 ItalySeeweb European cloud provider with GPU and Kubernetes servicesNeocloud 路 Other Nvidia GPUs Aethir WorldAethir Distributed cloud GPU network for AI and gamingMarketplace 路 Other Nvidia GPUs NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 HIVE Digital Technologies 馃嚚馃嚘 Canada and 2 moreHIVE Digital Technologies Clean-energy data centres for crypto mining and AI computeFormer miner 路 Other Nvidia GPUs 路 2017 Flux WorldFlux Decentralised cloud network for GPU workloads and web hostingMarketplace 路 Other Nvidia GPUs NAIRR Pilot 馃嚭馃嚫 United StatesNAIRR Pilot US federal pilot providing shared AI compute and data to researchersSovereign cloud 路 Other Nvidia GPUs 路 2024 Krutrim Cloud 馃嚠馃嚦 IndiaKrutrim Cloud India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Jarvislabs 馃嚠馃嚦 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper Voltage Park 馃嚭馃嚫 United StatesVoltage Park US GPU cloud selling on-demand and reserved AI compute from its own hardwareNeocloud 路 Other Nvidia GPUs Fluence 馃嚚馃嚟 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud 路 Other Nvidia GPUs 路 2017

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.