News
MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)MinersBitcoin Miners Are Selling Their Stacks to Fund the AI BoomClustersDDN picks up AMPHIX edge AI Factory-in-a-Box winClustersmicroagi trains robots for European industry at Telekom鈥檚 AI factoryDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersWhat Does Hewlett Packard Enterprise (HPE) Gaining A Top 14 AI Supercomputer Mean?ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)
EveryNeocloud

Inference platforms

Fireworks, Baseten, Replicate, Modal and the clouds that serve models by the token. 34 providers on EveryNeocloud so far.

An inference platform runs trained AI models for customers and charges for the work, usually by the token, the small chunk of text a language model reads or writes. Customers send a request to an API and get an answer back, without renting a whole GPU. Fireworks, Baseten, Together AI, Replicate and Modal are known examples, along with the chip companies Groq, Cerebras and SambaNova.

Training versus inference

Training a model is a long job that keeps thousands of GPUs busy for weeks. Inference is the opposite: millions of short requests that must be answered in a fraction of a second. Inference platforms pack many customers onto shared GPUs, batch requests together, cache repeated text and use tricks such as quantisation, storing numbers with fewer bits, to cut cost and delay. As AI tools spread, inference has become a larger share of all AI computing.

How they sell

Most publish prices per million input and output tokens for popular open models such as Llama, Qwen, DeepSeek and Mistral, and offer dedicated deployments for larger customers. Many rent their GPUs from neoclouds rather than owning them. The hyperscalers compete with services such as Amazon Bedrock, and routers such as OpenRouter send each request to whichever provider is cheapest or fastest.

Famous inference platform providers

Still to be written: Hugging Face.

Further reading

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.