Search: Inference
Concepts
Events
馃嚭馃嚫 United StatesInference.net
Marketplace for low-cost AI inference via unused GPU capacityInference platform
馃嚭馃嚫 United StatesSambaNova Systems
American provider of custom AI silicon and cloud inference services based on Reconfigurable Dataflow Units.Neocloud 路 Other and custom chips 路 2017
馃嚘馃嚭 Australia and 2 moreIREN
Australian GPU cloud and data centre operator for AI workloadsNeocloud 路 Other Nvidia GPUs 路 2018
馃嚤馃嚭 Luxembourg and 1 moreGcore
Luxembourg edge AI, cloud, CDN and security provider with GPU clusters in EuropeNeocloud 路 Other Nvidia GPUs 路 2011
馃嚭馃嚫 United StatesHyperion
A planned AI data center in Louisiana owned by Meta Platforms.Hyperscaler
馃嚭馃嚫 United StatesCloudflare
Edge network running Nvidia GPUs for AI inference via Workers AIInference platform 路 Other Nvidia GPUs 路 2009
馃嚭馃嚫 United States and 2 moreGroq
Chip designer and inference cloud built on its own Language Processing UnitChipmaker cloud 路 Groq LPU 路 2016
馃嚪馃嚭 RussiaYandex Cloud
Russian cloud computing and AI infrastructure providerNeocloud 路 Other Nvidia GPUs 路 1997
馃嚭馃嚫 United StatesCerebras
Developer of wafer-scale AI chips and supercomputers for inference and training.Neocloud 路 Cerebras wafer-scale 路 2016
馃嚪馃嚭 RussiaChristofari
Sberbank's Nvidia-based supercomputers in Moscow for neural network trainingSupercomputer 路 Other Nvidia GPUs 路 2019
馃嚠馃嚦 IndiaNeysa
GPU cloud and AI platform for enterprises in IndiaNeocloud 路 Other Nvidia GPUs
馃嚠馃嚦 IndiaJarvislabs
GPU cloud and inference platform based in IndiaNeocloud 路 Nvidia Hopper
WorldTensorWave
AMD-exclusive AI cloud for training and running large modelsNeocloud 路 AMD Instinct
WorldChutes
Serverless, decentralised compute for running open-source AI models in productionInference platform
馃嚭馃嚫 United StatesTogether AI
AI cloud running open models on demand, with GPU clusters and inference researchNeocloud 路 Nvidia Blackwell
WorldFluidstack
Compute infrastructure company building large-scale AI data centresNeocloud 路 Other and custom chips
馃嚭馃嚫 United States and 3 moreCrusoe
AI cloud and modular data centre operator that also builds its own power supplyNeocloud 路 Nvidia Blackwell
馃嚝馃嚠 FinlandVerda
European full-stack AI cloud offering GPU clusters, instances and model APIsNeocloud 路 Nvidia Blackwell
馃嚭馃嚫 United StatesFal
Serverless GPU platform for generative AI inferenceInference platform 路 Other Nvidia GPUs 路 2021
馃嚭馃嚫 United States and 1 moreAnyscale
Managed Ray platform for distributed AI workloadsDeveloper cloud 路 Other Nvidia GPUs
馃嚭馃嚫 United States and 1 moreModal
Serverless cloud platform for AI development and inferenceDeveloper cloud 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesDeepInfra
Inference cloud for open-source AI modelsInference platform 路 Nvidia Blackwell 路 2022
馃嚭馃嚫 United StatesFeatherless AI
Serverless inference platform for open-source AI modelsInference platform 路 AMD Instinct 路 2023
馃嚭馃嚫 United StatesFireworks AI
Platform for running and training open AI modelsInference platform 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesRunware
Serverless AI inference platform with custom hardwareInference platform 路 Other Nvidia GPUs 路 2023
馃嚝馃嚪 FranceKoyeb
Serverless cloud platform for AI inference and applicationsNeocloud 路 Other Nvidia GPUs 路 2021
馃嚭馃嚫 United StatesRunPod
AI developer cloud for training and inferenceNeocloud 路 Nvidia Blackwell
馃嚭馃嚫 United StatesSaturn Cloud
Managed inference platform for open AI models on dedicated GPUsInference platform 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesZenlayer
Distributed cloud infrastructure for global AI inferenceNeocloud 路 2014
馃嚭馃嚫 United StatesTensorDock
Marketplace for on-demand GPU servers and cloud instancesMarketplace 路 Nvidia Hopper
馃嚭馃嚫 United StatesVast.ai
Marketplace for distributed GPU cloud computeMarketplace 路 Nvidia Blackwell 路 2016
馃嚭馃嚫 United StatesHyperbolic
Unified platform for global GPU compute access and orchestrationMarketplace 路 Nvidia Hopper
WorldIo.net
Decentralised network for GPU computeMarketplace 路 Other Nvidia GPUs 路 2023
WorldSpheron Network
Marketplace for renting enterprise NVIDIA and AMD GPUsMarketplace 路 Nvidia Blackwell
馃嚭馃嚫 United StatesSaladCloud
Distributed GPU cloud using idle consumer hardwareNeocloud 路 Other Nvidia GPUs 路 2018
WorldLivepeer
Open network for AI video inference workloadsMarketplace 路 Other Nvidia GPUs
WorldTheta EdgeCloud
Distributed GPU network for AI inference and agentsNeocloud 路 Nvidia Hopper
馃嚭馃嚫 United StatesPhala Cloud
Verifiable private AI compute on GPU TEEsNeocloud 路 Nvidia Hopper
馃嚭馃嚫 United StatesNvidia DGX Cloud Lepton
Unified platform for multi-cloud GPU compute accessMarketplace 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesIonstream
Bare-metal NVIDIA GPU servers with automated provisioning and optimised networkingNeocloud 路 Other Nvidia GPUs
馃嚠馃嚦 IndiaYotta Shakti Cloud
India's sovereign AI cloud platform with NVIDIA GPU infrastructureSovereign cloud 路 Nvidia Hopper
馃嚭馃嚫 United StatesLatitude.sh
Global bare metal cloud for AI workloadsNeocloud 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesInferless
Serverless GPU inference platform for custom modelsInference platform 路 Other Nvidia GPUs
馃嚠馃嚦 IndiaKrutrim Cloud
India-native AI cloud platform for training and inferenceNeocloud 路 Other Nvidia GPUs
馃嚭馃嚫 United StatesAvian
Serverless and dedicated GPU inference for open-source modelsInference platform 路 Nvidia Blackwell
馃嚢馃嚪 South KoreaFriendliAI
Accelerated generative AI inference serving platformInference platform 路 Other Nvidia GPUs
WorldReplicate
Run, fine-tune and deploy AI models through one APIInference platform
馃嚠馃嚦 IndiaSimplismart
AI inference platform for custom model deployment and scalingInference platform 路 Nvidia Blackwell
馃嚠馃嚦 IndiaE2E Networks
India's listed GPU cloud for AI training and inference.Neocloud 路 Nvidia Hopper 路 2009
馃嚭馃嚫 United StatesTargon
On-demand NVIDIA GPU cloud for training and inferenceNeocloud 路 Other Nvidia GPUs
馃嚛馃嚜 GermanyPolarise
German sovereign AI cloud running its own data centres and open-weight model APIsNeocloud 路 Nvidia Blackwell 路 2024
WorldGMI Cloud
AI-native cloud for production inference, GPU clusters and agent runtimesNeocloud 路 Nvidia Hopper
WorldOblivus
On-demand and reserved GPU cloud for training, inference and renderingNeocloud 路 Other Nvidia GPUs
WorldHot Aisle
Developer-first cloud for sovereign inference on isolated AMD GPUsNeocloud 路 AMD Instinct 路 2023
馃嚭馃嚫 United StatesLambda
AI-only GPU cloud running NVIDIA supercomputers for training and inferenceNeocloud 路 Nvidia Blackwell 路 2012
馃嚭馃嚫 United StatesBaseten
Inference cloud for running AI models in productionInference platform
馃嚭馃嚫 United StatesParasail
Inference cloud for AI startups, billed by token.Inference platform 路 Other and custom chips
馃嚢馃嚪 South KoreaNHN Cloud
South Korean cloud provider with large GPU clusters for AI trainingNeocloud 路 Nvidia Blackwell
WorldAethir
Distributed cloud GPU network for AI and gamingMarketplace 路 Other Nvidia GPUs
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Cerebras: Coolcaesar, CC BY 4.0, source
- Cloudflare: HaeB, CC BY-SA 4.0, source
- Groq: Avivweinstein, CC BY-SA 4.0, source
- Yandex Cloud: WikiFido, CC BY-SA 4.0, source