News
MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom’s AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)
EveryNeocloud

Groq LPU

Groq's language processing units. 1 provider on EveryNeocloud so far.

The language processing unit (LPU) is the chip made by Groq, a company founded in 2016 by Jonathan Ross, who earlier helped start Google's TPU project. Groq sells it almost entirely as a service, GroqCloud, which serves open models through an API. Its pitch is speed: answers that stream out at hundreds of tokens per second for each user.

How it works

An LPU holds model data in SRAM, very fast memory on the chip itself, rather than in separate high-bandwidth memory. The compiler plans every step in advance, so the chip runs in a fixed, predictable order with no waiting. Because each chip holds little memory, a large model is spread across hundreds of LPUs, which makes Groq systems big but fast.

Where it runs

Groq runs data centres in the US, with Bell Canada in Canada, with Humain in Saudi Arabia and, from July 2025, in Helsinki with Equinix. In December 2025 Nvidia signed a non-exclusive licence for Groq's technology and hired its founder and other leaders, while Groq said GroqCloud would keep running as an independent company.

Famous groq LPU providers

Still to be written: Bell Canada.

Further reading

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.