News
DealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise ExpansionDealsCorvex agrees USD 103 million take-or-pay deal to perform AI inference with Mid-Atlantic GPUsSovereignNeysa scales AI infrastructure in India with AMD Instinct MI350X GPUs on TytanInferenceMicrosoft Foundry adds Baseten, DeepSeek AI inference (MSFT:NASDAQ)ClustersDataOne and Rowan University sign engineering co-op program agreement for DataOne's Vineland AI factoryClustersLook inside Cal Poly's $3 million AI Factory (Video)DealsOpenAI Taps AMD Chips for 457 MW of AI Capacity in Six-Year TensorWave DealClustersCal Poly launches an AI data center on campus. Take a look insideInferenceArista takes aim at the next AI network battleground: distributed inferenceDealsOpenAI Signs 457 MW AI Data Center Deal as AMD Expands Its Challenge to NvidiaClustersBehind Dell AI Factory鈥檚 NVIDIA & AMD Enterprise Expansion
EveryNeocloud

Model APIs

Open models served through an API, by the token. 50 providers on EveryNeocloud so far.

A model API sells the output of a model rather than the hardware: the customer sends text or images and pays per million tokens. Inference platforms, chip clouds and hyperscalers all serve open models this way, from Llama and Qwen to DeepSeek and Mistral. For many companies this is the simplest way to use AI compute, with no GPUs to manage at all.

How it is priced

Prices are set per million input tokens and per million output tokens, with output usually costing more because it is generated one token at a time. Providers compete on price, on speed in tokens per second, and on the delay before the first token. Independent benchmarks compare them model by model, and prices for the same model can differ several times between providers.

Who serves them

Groq, Cerebras and SambaNova serve models on their own chips. Neoclouds such as Nebius and Together AI, and European clouds such as Scaleway, run APIs on Nvidia GPUs. AWS offers many models through Bedrock. Routers such as OpenRouter let one account call hundreds of models across providers. The companies that make closed models, such as OpenAI and Anthropic, run their own APIs.

Famous model APIs providers

Further reading

馃嚭馃嚫 United States and 4 moreGoogle data centers Hyperscale campuses running Search, YouTube, Gemini and Google Cloud AI workloadsHyperscaler 路 Google TPU 馃嚭馃嚫 United StatesSpaceX Super Intelligence Musk's AI company behind Grok and the Colossus data centres, now part of SpaceX.Neocloud 路 Nvidia Hopper 路 2023 馃嚪馃嚭 RussiaYandex Cloud Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997 G42 馃嚘馃嚜 United Arab Emirates and 4 moreG42 Abu Dhabi AI holding group running cloud, data centres and national compute projectsNeocloud 路 Nvidia Blackwell 路 2018 馃嚠馃嚦 IndiaJio Platforms Reliance's holding group for Jio telecom, apps, cloud and AI servicesHyperscaler 路 2019 馃嚭馃嚫 United StatesOpenRouter One API that routes requests to hundreds of AI modelsInference platform 路 2023 SambaNova Systems 馃嚭馃嚫 United StatesSambaNova Systems American provider of custom AI silicon and cloud inference services based on Reconfigurable Dataflow Units.Neocloud 路 Other and custom chips 路 2017 Amazon Bedrock 馃嚭馃嚫 United StatesAmazon Bedrock Serverless platform giving one API to many foundation modelsInference platform 路 2023 Tencent Cloud 馃嚚馃嚦 China and 4 moreTencent Cloud Tencent's global cloud arm: 66 availability zones, 700+ services, AI and media toolsHyperscaler 路 2013 馃嚭馃嚫 United StatesCloudflare Edge network running Nvidia GPUs for AI inference via Workers AIInference platform 路 Other Nvidia GPUs 路 2009 Humain 馃嚫馃嚘 Saudi ArabiaHumain Saudi AI company building data centres, cloud services and Arabic modelsNeocloud 路 Other Nvidia GPUs 路 2025 馃嚭馃嚫 United States and 2 moreGroq Chip designer and inference cloud built on its own Language Processing UnitChipmaker cloud 路 Groq LPU 路 2016 馃嚭馃嚫 United StatesCerebras Developer of wafer-scale AI chips and supercomputers for inference and training.Neocloud 路 Cerebras wafer-scale 路 2016 馃嚚馃嚦 ChinaBaidu Chinese search and AI group with its own cloud, chips and foundation modelsHyperscaler 路 Other and custom chips 路 2000 Rackspace Technology 馃嚭馃嚫 United States and 4 moreRackspace Technology Managed cloud and AI services firm running data centres worldwideNeocloud 路 1998 Yandex Cloud 馃嚪馃嚭 RussiaYandex Cloud Yandex's public cloud, offering compute, data and ML services to Russian businessesHyperscaler 路 Other Nvidia GPUs 路 2018 T Cloud Public 馃嚛馃嚜 Germany and 2 moreT Cloud Public Deutsche Telekom's OpenStack-based infrastructure-as-a-service cloud, run by T-Systems.Hyperscaler 路 2016 PPIO 馃嚚馃嚦 ChinaPPIO Independent AI cloud for agent infrastructure and GPU computeNeocloud 路 Other Nvidia GPUs 路 2018 Fireworks AI 馃嚭馃嚫 United StatesFireworks AI Platform for running and training open AI modelsInference platform 路 Other Nvidia GPUs Runware 馃嚭馃嚫 United StatesRunware Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023 Saturn Cloud 馃嚭馃嚫 United StatesSaturn Cloud Managed inference platform for open AI models on dedicated GPUsInference platform 路 Other Nvidia GPUs SaladCloud 馃嚭馃嚫 United StatesSaladCloud Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018 E2E Networks 馃嚠馃嚦 IndiaE2E Networks India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009 Theta EdgeCloud WorldTheta EdgeCloud Distributed GPU network for AI inference and agentsNeocloud 路 Nvidia Hopper Phala Cloud 馃嚭馃嚫 United StatesPhala Cloud Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper Nvidia DGX Cloud Lepton 馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs IndiaAI Compute Portal 馃嚠馃嚦 IndiaIndiaAI Compute Portal National cloud platform for affordable AI compute in IndiaSovereign cloud 路 Nvidia Hopper Inferless 馃嚭馃嚫 United StatesInferless Serverless GPU inference platform for custom modelsInference platform 路 Other Nvidia GPUs Golem Network 馃嚚馃嚟 SwitzerlandGolem Network Decentralized marketplace for GPU and CPU computeMarketplace 路 Other Nvidia GPUs 路 2016 Avian 馃嚭馃嚫 United StatesAvian Serverless and dedicated GPU inference for open-source modelsInference platform 路 Nvidia Blackwell FriendliAI 馃嚢馃嚪 South KoreaFriendliAI Accelerated generative AI inference serving platformInference platform 路 Other Nvidia GPUs Replicate WorldReplicate Run, fine-tune and deploy AI models through one APIInference platform Simplismart 馃嚠馃嚦 IndiaSimplismart AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell Livepeer WorldLivepeer Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs Polarise 馃嚛馃嚜 GermanyPolarise German sovereign AI cloud running its own data centres and open-weight model APIsNeocloud 路 Nvidia Blackwell 路 2024 GMI Cloud WorldGMI Cloud AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper Oblivus WorldOblivus On-demand and reserved GPU cloud for training, inference and renderingNeocloud 路 Other Nvidia GPUs Baseten 馃嚭馃嚫 United StatesBaseten Inference cloud for running AI models in productionInference platform Parasail 馃嚭馃嚫 United StatesParasail Inference cloud for AI startups, billed by token.Inference platform 路 Other and custom chips Neysa 馃嚠馃嚦 IndiaNeysa GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs Jarvislabs 馃嚠馃嚦 IndiaJarvislabs GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper Chutes WorldChutes Serverless, decentralised compute for running open-source AI models in productionInference platform Together AI 馃嚭馃嚫 United StatesTogether AI AI cloud running open models on demand, with GPU clusters and inference researchNeocloud 路 Nvidia Blackwell GreenNode 馃嚮馃嚦 Vietnam and 1 moreGreenNode Sovereign AI and public cloud with GPU instances across Vietnam and ThailandNeocloud Ubitus 馃嚡馃嚨 JapanUbitus GPU virtualisation and cloud gaming company running AI compute centres across AsiaNeocloud 路 Other Nvidia GPUs 路 2012 Fal 馃嚭馃嚫 United StatesFal Serverless GPU platform for generative AI inferenceInference platform 路 Other Nvidia GPUs 路 2021 Novita AI 馃嚭馃嚫 United StatesNovita AI AI cloud platform offering model APIs and GPU instances for developers.Neocloud 路 Other Nvidia GPUs DeepInfra 馃嚭馃嚫 United StatesDeepInfra Inference cloud for open-source AI modelsInference platform 路 Nvidia Blackwell 路 2022

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the provider of the day, new pages on EveryNeocloud, and the conferences and anniversaries of the week ahead.