News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Nvidia Hopper

H100, H200 and GH200. 43 providers on EveryNeocloud so far.

Hopper is the Nvidia GPU generation that powered the first wave of the generative AI boom. The H100, announced in March 2022 and shipped from late that year, became the most sought-after chip in the world in 2023. It was followed by the H200, with more memory, and the GH200 Grace Hopper Superchip, which pairs a Hopper GPU with an Arm-based Grace CPU on one board.

The chip

The H100 has 80 billion transistors on TSMC's 4N process and introduced the Transformer Engine, hardware that switches to 8-bit numbers (FP8) for parts of a model where precision matters less. It comes as an SXM module for eight-GPU servers or as a PCIe card. The H200 of 2024 raised memory to 141 GB of HBM3e. For China, Nvidia sold cut-down versions, the H800 and later the H20, under US export rules.

Where it runs

Most neocloud fleets were built on H100s: CoreWeave, Nebius, Lambda, Northern Data and India's Yotta and E2E all grew on them, and Colossus began with about 100,000. The GH200 is the base of several national supercomputers, including JUPITER, Alps and Isambard-AI. As Blackwell arrives, H100 rental prices have fallen, and many H100 clusters now serve inference and smaller training jobs.

Famous nvidia Hopper providers

Still to be written: Jupiter (supercomputer), AI Bridging Cloud Infrastructure.

Further reading

馃嚭馃嚫 United States and 1 moreCoreWeave US GPU cloud running AI data centres for hyperscalers and model labsNeocloud 路 Nvidia Hopper 路 2017 DigitalOcean 馃嚭馃嚫 United States and 2 moreDigitalOcean Alternative cloud for developers, with GPU Droplets for AI workDeveloper cloud 路 Nvidia Hopper 路 2011 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 Colossus 馃嚭馃嚫 United StatesColossus An AI supercomputer cluster in Tennessee and Mississippi built by xAI.Supercomputer 路 Nvidia Hopper 路 2024 馃嚡馃嚨 JapanTsubame A long-running Japanese supercomputer series built for AI and scientific computing.Supercomputer 路 Nvidia Hopper 路 2006 馃嚜馃嚫 Spain and 1 moreMareNostrum Spain's main supercomputer at the Barcelona Supercomputing CenterSupercomputer 路 Nvidia Hopper 路 2005 Northern Data 馃嚛馃嚜 Germany and 4 moreNorthern Data German GPU cloud and data centre group for AI and high-performance computingNeocloud 路 Nvidia Hopper 路 2019 Starcloud 馃嚭馃嚫 United StatesStarcloud Orbital data centres built and operated by a US space computing companyNeocloud 路 Nvidia Hopper 路 2023 Megaspeed 馃嚫馃嚞 Singapore and 4 moreMegaspeed Singapore AI cloud firm investigated over Nvidia chip diversion to ChinaNeocloud 路 Nvidia Blackwell 路 2015 Ubilink 馃嚬馃嚰 TaiwanUbilink Taiwanese AI supercomputing firm running an NVIDIA H100 clusterSupercomputer 路 Nvidia Hopper Verda 馃嚝馃嚠 FinlandVerda European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell Cerebrium 馃嚳馃嚘 South AfricaCerebrium Serverless GPU infrastructure for real-time AI workloadsInference platform 路 Nvidia Hopper RunPod 馃嚭馃嚫 United StatesRunPod AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell TensorDock 馃嚭馃嚫 United StatesTensorDock Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper GPU Mart 馃嚭馃嚫 United StatesGPU Mart Dedicated GPU VPS and bare-metal servers for AI and rendering.Neocloud 路 Nvidia Blackwell 路 2021 Hyperbolic 馃嚭馃嚫 United StatesHyperbolic Unified platform for global GPU compute access and orchestrationMarketplace 路 Nvidia Hopper Compute Exchange 馃嚭馃嚫 United StatesCompute Exchange Marketplace for buying and selling GPU compute capacity and hardware.Marketplace 路 Nvidia Hopper Spheron Network WorldSpheron Network Marketplace for renting enterprise NVIDIA and AMD GPUsMarketplace 路 Nvidia Blackwell Lium 馃嚢馃嚦 Saint Kitts and NevisLium GPU rental marketplace with per-second billingMarketplace 路 Nvidia Blackwell Theta EdgeCloud WorldTheta EdgeCloud Distributed GPU network for AI inference and agentsNeocloud 路 Nvidia Hopper Phala Cloud 馃嚭馃嚫 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper Ornn WorldOrnn Marketplace for buying and trading GPU compute capacityMarketplace 路 Nvidia Hopper Kinesis Network 馃嚭馃嚫 United States and 1 moreKinesis Network Control plane for distributed GPU computeNeocloud 路 Nvidia Hopper Eos 馃嚭馃嚫 United StatesEos Nvidia's DGX SuperPOD AI supercomputer for internal researchSupercomputer 路 Nvidia Hopper 路 2023 Isambard-AI 馃嚞馃嚙 United KingdomIsambard-AI UK鈥檚 most powerful AI supercomputer for research and industrySupercomputer 路 Nvidia Hopper 路 2025 Gefion EuropeGefion Denmark's sovereign AI supercomputer for science and industrySovereign cloud 路 Nvidia Hopper ASPIRE 2A+ 馃嚫馃嚞 SingaporeASPIRE 2A+ Singapore national AI supercomputer with 320 Nvidia H100 GPUsSupercomputer 路 Nvidia Hopper Cortex 馃嚭馃嚫 United StatesCortex Tesla's AI training cluster for autonomous driving and robotics.Supercomputer 路 Nvidia Hopper AI Research Resource 馃嚞馃嚙 United KingdomAI Research Resource UK national supercomputing programme for AI research and industrySovereign cloud 路 Nvidia Hopper 路 2023 Yotta Shakti Cloud 馃嚠馃嚦 IndiaYotta Shakti Cloud India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper IndiaAI Compute Portal 馃嚠馃嚦 IndiaIndiaAI Compute Portal National cloud platform for affordable AI compute in IndiaSovereign cloud 路 Nvidia Hopper Thunder Compute 馃嚭馃嚫 United StatesThunder Compute GPU sandboxes and instances for AI developersDeveloper cloud 路 Nvidia Hopper Beam WorldBeam Developer cloud for AI agents and GPU workloadsDeveloper cloud 路 Other Nvidia GPUs Akash Network WorldAkash Network Decentralized marketplace for GPU and CPU compute powerMarketplace 路 Nvidia Hopper Simplismart 馃嚠馃嚦 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Israel-1 馃嚠馃嚤 IsraelIsrael-1 Nvidia AI supercomputer in Israel for research and partnersSupercomputer 路 Nvidia Hopper 路 2023 Arc Compute 馃嚭馃嚫 United StatesArc Compute Turnkey NVIDIA GPU cluster design, deployment and management for AI workloadsNeocloud 路 Nvidia Blackwell 路 2018 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper Lambda 馃嚭馃嚫 United StatesLambda AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012 Jarvislabs 馃嚠馃嚦 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper Crusoe 馃嚭馃嚫 United States and 3 moreCrusoe AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell CUDO Compute 馃嚞馃嚙 United KingdomCUDO Compute European AI infrastructure builder deploying and operating NVIDIA GPU clustersNeocloud 路 Nvidia Hopper

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.