Nvidia Ampere
The A100 and A10 generation. 23 providers on EveryNeocloud so far.
Ampere is the Nvidia generation of 2020, and its data centre chip, the A100, trained many of the models released between 2020 and 2023. It also includes the A10, A30 and A40 cards for inference and graphics. A100s still run in clouds, universities and national supercomputers, though they are now a generation and a half behind.
The A100
Announced in May 2020, the A100 has 54 billion transistors on a 7 nm process from TSMC and came with 40 GB, later 80 GB, of high-bandwidth memory. It introduced TF32, a number format that sped up training without code changes, and Multi-Instance GPU (MIG), which splits one GPU into up to seven smaller ones so several users can share it. Nvidia's DGX A100 server held eight.
Where it runs
The A100 was the base of many supercomputers of 2020 to 2023: Leonardo in Italy, Perlmutter at Berkeley Lab, Nvidia's own Selene, JUWELS Booster at J眉lich, India's PARAM Siddhi-AI and AIRAWAT, and NCAR's Derecho. Neoclouds and developer clouds still rent A100s at low prices for tuning and inference. The A800 was a version for China until US rules blocked it in 2023.
Famous nvidia Ampere providers
Further reading
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- JUWELS: Forschungszentrum J眉lich, CC BY-SA 4.0, source
- NCAR-Wyoming Supercomputing Center: National Science Foundation, Public domain, source
- Leonardo: Quirinale, Attribution, source
