News
InferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip CurbsSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutMinersFrom Bitcoin to AI: A $1.2 Billion Bet That Could BackfireInferenceAMD Completes Taalas Acquisition to Strengthen AI Inference PortfolioSovereignIndia’s Sarvam AI launches GPU service for open modelsClustersNew UB North Campus structure to house AI supercomputer system for research usesNeocloudsJensen Huang’s Charity Committed $350 Million to CoreWeaveClustersOak Ridge's AI Factory Moment: Lux, Nuclear Power, and the Next Data Center FrontierDealsNscale’s ByteDance GPU deal draws scrutiny over US chip curbsDealsNscale’s ByteDance Deal Faces Scrutiny Under US Chip CurbsSovereignNexusIgnite Plans Sovereign AI Cloud in Jordan, Starting With Its UniversitiesSovereignNexGen Cloud Appoints Dan Thomas as Chief Infrastructure Officer to Lead Next Phase of European AI Infrastructure Build-OutMinersFrom Bitcoin to AI: A $1.2 Billion Bet That Could Backfire
EveryNeocloud

Groq LPU

Groq's language processing units. 1 provider on EveryNeocloud so far.

The language processing unit (LPU) is the chip made by Groq, a company founded in 2016 by Jonathan Ross, who earlier helped start Google's TPU project. Groq sells it almost entirely as a service, GroqCloud, which serves open models through an API. Its pitch is speed: answers that stream out at hundreds of tokens per second for each user.

How it works

An LPU holds model data in SRAM, very fast memory on the chip itself, rather than in separate high-bandwidth memory. The compiler plans every step in advance, so the chip runs in a fixed, predictable order with no waiting. Because each chip holds little memory, a large model is spread across hundreds of LPUs, which makes Groq systems big but fast.

Where it runs

Groq runs data centres in the US, with Bell Canada in Canada, with Humain in Saudi Arabia and, from July 2025, in Helsinki with Equinix. In December 2025 Nvidia signed a non-exclusive licence for Groq's technology and hired its founder and other leaders, while Groq said GroqCloud would keep running as an independent company.

Famous groq LPU providers

Still to be written: Bell Canada.

Further reading

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.