News
Inferenceai& to Provide NEC with Sovereign AI Inference Platform to Accelerate AI-Native TransformationDealsGPUs reshape colocation versus private data center decisionsSovereignDeutsche Telekom boosts its sovereign AI push with 100 million for MistralNeocloudsSpaceX has a CoreWeave problem that no one is talking aboutInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia鈥檚 Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesClustersIntroducing Together Storage Accelerator: fast, free data caching for your GPU clusterNeocloudsJensen Huang鈥檚 Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierInferenceai& to Provide NEC with Sovereign AI Inference Platform to Accelerate AI-Native TransformationDealsGPUs reshape colocation versus private data center decisionsSovereignDeutsche Telekom boosts its sovereign AI push with 100 million for MistralNeocloudsSpaceX has a CoreWeave problem that no one is talking aboutInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia鈥檚 Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesClustersIntroducing Together Storage Accelerator: fast, free data caching for your GPU clusterNeocloudsJensen Huang鈥檚 Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center Frontier
EveryNeocloud

Other Nvidia GPUs

L40S, RTX and earlier Volta and Pascal cards. 116 providers on EveryNeocloud so far.

Beyond its flagship data centre chips, Nvidia sells many other GPUs that clouds rent out: the L40S and L4 of the Ada Lovelace generation, RTX workstation and gaming cards, the T4 for inference, and older data centre parts such as the Volta V100 of 2017 and the Pascal P100 of 2016. These cards fill the long tail of AI work, where a single cheaper GPU is enough.

The older generations

The P100 of 2016 brought high-bandwidth memory to Nvidia GPUs, and the V100 of 2017 introduced Tensor Cores, units built for the matrix maths of neural networks. The V100 powered Summit and Sierra in the US, Taiwania 2 and Japan's first ABCI. Earlier still, Titan at Oak Ridge used Kepler GPUs in 2012, one of the first large bets on GPUs for science.

Cards for inference and graphics

The L40S, launched in 2023, has 48 GB of memory and handles both AI inference and 3D graphics, and the small, low-power L4 suits video and light inference. Developer clouds such as Vultr and DigitalOcean rent these by the hour. Marketplaces also list many consumer RTX cards, such as the RTX 4090, which are cheap but lack the memory and fast links of data centre GPUs.

Famous other Nvidia GPUs providers

Still to be written: Vultr.

Further reading

SF Compute 馃嚭馃嚫 United StatesSF Compute GPU cloud with a resale market for reserved capacityNeocloud 路 Other Nvidia GPUs Aethir WorldAethir Distributed cloud GPU network for AI and gamingMarketplace 路 Other Nvidia GPUs NodeShift 馃嚞馃嚙 United KingdomNodeShift Decentralized cloud platform for excess compute and storageMarketplace 路 Other Nvidia GPUs 路 2024 TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper Render Network WorldRender Network Decentralised GPU network for rendering and AI computeMarketplace 路 Other Nvidia GPUs Nosana WorldNosana Decentralised marketplace for on-demand GPU computeMarketplace 路 Other Nvidia GPUs Clore.ai WorldClore.ai Decentralised marketplace for renting NVIDIA GPUsMarketplace 路 Other Nvidia GPUs Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs Kinesis Network 馃嚭馃嚫 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud 路 Nvidia Hopper Nvidia DGX Cloud Lepton 馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs Golem Network 馃嚚馃嚟 SwitzerlandGolem Network Decentralized marketplace for GPU and CPU computeMarketplace 路 Other Nvidia GPUs 路 2016 Shadeform 馃嚭馃嚫 United StatesShadeform Marketplace for GPU cloud access across multiple providersMarketplace 路 Other Nvidia GPUs Fluence 馃嚚馃嚟 SwitzerlandFluence Decentralised marketplace for GPU and CPU cloud computeNeocloud 路 Other Nvidia GPUs 路 2017 Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.