News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanSovereignNeysa Deploys AMD GPU Cluster in Mumbai for AI Training and InferenceInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to Nvidia
EveryNeocloud

Model APIs

Open models served through an API, by the token. 50 providers on EveryNeocloud so far.

A model API sells the output of a model rather than the hardware: the customer sends text or images and pays per million tokens. Inference platforms, chip clouds and hyperscalers all serve open models this way, from Llama and Qwen to DeepSeek and Mistral. For many companies this is the simplest way to use AI compute, with no GPUs to manage at all.

How it is priced

Prices are set per million input tokens and per million output tokens, with output usually costing more because it is generated one token at a time. Providers compete on price, on speed in tokens per second, and on the delay before the first token. Independent benchmarks compare them model by model, and prices for the same model can differ several times between providers.

Who serves them

Groq, Cerebras and SambaNova serve models on their own chips. Neoclouds such as Nebius and Together AI, and European clouds such as Scaleway, run APIs on Nvidia GPUs. AWS offers many models through Bedrock. Routers such as OpenRouter let one account call hundreds of models across providers. The companies that make closed models, such as OpenAI and Anthropic, run their own APIs.

Famous model APIs providers

Further reading

🇺🇸 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud · Nvidia Hopper · 2023 🇺🇸 United StatesCloudflare Edge network running Nvidia GPUs for AI inference via Workers AIInference platform · Other Nvidia GPUs · 2009 Jarvislabs 🇮🇳 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud · Nvidia Hopper Fal 🇺🇸 United StatesFal Serverless GPU platform for generative AI inferenceInference platform · Other Nvidia GPUs · 2021 Novita AI 🇺🇸 United StatesNovita AI AI cloud platform offering model APIs and GPU instances for developers.Neocloud · Other Nvidia GPUs DeepInfra 🇺🇸 United StatesDeepInfra Inference cloud for open-source AI modelsInference platform · Nvidia Blackwell · 2022 PPIO 🇨🇳 ChinaPPIO Independent AI cloud for agent infrastructure and GPU computeNeocloud · Other Nvidia GPUs · 2018 Fireworks AI 🇺🇸 United StatesFireworks AI Platform for running and training open AI modelsInference platform · Other Nvidia GPUs Runware 🇺🇸 United StatesRunware Serverless AI inference platform with custom hardwareInference platform · Other Nvidia GPUs · 2023 Saturn Cloud 🇺🇸 United StatesSaturn Cloud Managed inference platform for open AI models on dedicated GPUsInference platform · Other Nvidia GPUs Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace · Other Nvidia GPUs Inferless 🇺🇸 United StatesInferless Serverless GPU inference platform for custom modelsInference platform · Other Nvidia GPUs FriendliAI 🇰🇷 South KoreaFriendliAI Accelerated generative AI inference serving platformInference platform · Other Nvidia GPUs Simplismart 🇮🇳 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform · Nvidia Blackwell Neysa 🇮🇳 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud · Other Nvidia GPUs

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.