News
InferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip CurbsSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutMinersFrom Bitcoin to AI: A $1.2 Billion Bet That Could BackfireInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip CurbsSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutMinersFrom Bitcoin to AI: A $1.2 Billion Bet That Could Backfire
EveryNeocloud

Nvidia Hopper

H100, H200 and GH200. 43 providers on EveryNeocloud so far.

Hopper is the Nvidia GPU generation that powered the first wave of the generative AI boom. The H100, announced in March 2022 and shipped from late that year, became the most sought-after chip in the world in 2023. It was followed by the H200, with more memory, and the GH200 Grace Hopper Superchip, which pairs a Hopper GPU with an Arm-based Grace CPU on one board.

The chip

The H100 has 80 billion transistors on TSMC's 4N process and introduced the Transformer Engine, hardware that switches to 8-bit numbers (FP8) for parts of a model where precision matters less. It comes as an SXM module for eight-GPU servers or as a PCIe card. The H200 of 2024 raised memory to 141 GB of HBM3e. For China, Nvidia sold cut-down versions, the H800 and later the H20, under US export rules.

Where it runs

Most neocloud fleets were built on H100s: CoreWeave, Nebius, Lambda, Northern Data and India's Yotta and E2E all grew on them, and Colossus began with about 100,000. The GH200 is the base of several national supercomputers, including JUPITER, Alps and Isambard-AI. As Blackwell arrives, H100 rental prices have fallen, and many H100 clusters now serve inference and smaller training jobs.

Famous nvidia Hopper providers

Still to be written: Jupiter (supercomputer), AI Bridging Cloud Infrastructure.

Further reading

🇺🇸 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud · Nvidia Hopper · 2017 Northern Data 🇩🇪 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud · Nvidia Hopper · 2019 Megaspeed 🇸🇬 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud · Nvidia Blackwell · 2015 Arc Compute 🇺🇸 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud · Nvidia Blackwell · 2018 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud · Nvidia Hopper Crusoe 🇺🇸 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud · Nvidia Blackwell CUDO Compute 🇬🇧 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud · Nvidia Hopper Verda 🇫🇮 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud · Nvidia Blackwell TensorDock 🇺🇸 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace · Nvidia Hopper GPU Mart 🇺🇸 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud · Nvidia Blackwell · 2021 Hyperbolic 🇺🇸 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace · Nvidia Hopper RunPod 🇺🇸 United StatesRunPod AI developer cloud for training and inferenceNeocloud · Nvidia Blackwell Lambda 🇺🇸 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud · Nvidia Blackwell · 2012 Phala Cloud 🇺🇸 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud · Nvidia Hopper Yotta Shakti Cloud 🇮🇳 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud · Nvidia Hopper E2E Networks 🇮🇳 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud · Nvidia Hopper · 2009

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.