News
MinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)MinersBitcoin miner that sold its last BTC warns it may run short of cash for $1.2 billion AI dealClustersLumen’s Rob Ward: 'The AI factory has no walls'NeocloudsAWS Lambda now supports GPU instances for Event Functions on Lambda Managed InstancesMinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)
EveryNeocloud

Nvidia Ampere

The A100 and A10 generation. 23 providers on EveryNeocloud so far.

Ampere is the Nvidia generation of 2020, and its data centre chip, the A100, trained many of the models released between 2020 and 2023. It also includes the A10, A30 and A40 cards for inference and graphics. A100s still run in clouds, universities and national supercomputers, though they are now a generation and a half behind.

The A100

Announced in May 2020, the A100 has 54 billion transistors on a 7 nm process from TSMC and came with 40 GB, later 80 GB, of high-bandwidth memory. It introduced TF32, a number format that sped up training without code changes, and Multi-Instance GPU (MIG), which splits one GPU into up to seven smaller ones so several users can share it. Nvidia's DGX A100 server held eight.

Where it runs

The A100 was the base of many supercomputers of 2020 to 2023: Leonardo in Italy, Perlmutter at Berkeley Lab, Nvidia's own Selene, JUWELS Booster at Jülich, India's PARAM Siddhi-AI and AIRAWAT, and NCAR's Derecho. Neoclouds and developer clouds still rent A100s at low prices for tuning and inference. The A800 was a version for China until US rules blocked it in 2023.

Famous nvidia Ampere providers

Further reading

🇮🇹 ItalyLeonardo A petascale supercomputer built by Atos for CINECA in Bologna, Italy.Supercomputer · Nvidia Ampere · 2022 🇺🇸 United StatesNCAR-Wyoming Supercomputing Center A high-performance computing and data archival facility in Cheyenne, Wyoming.Supercomputer · Other Nvidia GPUs · 2003 🇩🇪 GermanyJUWELS A modular supercomputer at the Jülich Supercomputing Centre using AMD and Nvidia hardware.Supercomputer · Nvidia Ampere · 2020 DEGIMA 🇯🇵 JapanDEGIMA GPU cluster at Nagasaki University for astrophysical N-body simulationsSupercomputer · Nvidia Ampere 🇺🇸 United StatesNERSC US Department of Energy supercomputing centre for open science researchSupercomputer · Nvidia Ampere · 1974 Perlmutter 🇺🇸 United StatesPerlmutter A DOE supercomputer at NERSC for fusion and climate research.Supercomputer · Nvidia Ampere · 2021 Selene 🇺🇸 United StatesSelene Nvidia's own DGX SuperPOD supercomputer, built in three months in 2020Supercomputer · Nvidia Ampere · 2020 Deucalion 🇵🇹 PortugalDeucalion Portugal's fastest supercomputer, hosted at MACC in GuimarãesSupercomputer · Nvidia Ampere · 2023 Piz Daint 🇨🇭 SwitzerlandPiz Daint Swiss national supercomputer at CSCS, upgraded to Cray XC50/XC40 with Tesla P100 GPUsSupercomputer · Nvidia Ampere · 2012 Christofari 🇷🇺 RussiaChristofari Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer · Other Nvidia GPUs · 2019 🇯🇵 JapanEarth Simulator Japanese vector supercomputer series built for global climate and solid earth simulation.Supercomputer · Other and custom chips · 2002 Berzelius 🇸🇪 SwedenBerzelius Swedish AI supercomputer at Linköping UniversitySupercomputer · Nvidia Ampere

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.