Serverless GPUs
Pay per second, scale to zero. 41 providers on EveryNeocloud so far.
Serverless GPUs let customers run code on a GPU without choosing or managing a server. They upload a model or a function, the platform starts a GPU when a request comes in and bills by the second, and when no requests come the cost falls to zero. Modal, RunPod, Replicate and Baseten are known for it, and the big clouds and Cloudflare have added it.
How it works
The platform keeps a pool of GPUs and loads each customer's container when needed. The hard part is the cold start, the time to load a large model onto a GPU, which can take seconds or minutes. Platforms cut it by caching models, keeping some copies warm and loading weights in parallel. Billing per second suits uneven traffic, such as an app that is busy by day and quiet at night.
Who offers it
Google added GPUs to its Cloud Run service in 2025, and Microsoft offers serverless GPUs in Azure Container Apps. Cloudflare runs models on GPUs in its network through Workers AI, launched in 2023. Hugging Face lets users call many models without managing servers. For steady, heavy traffic, reserved servers usually cost less than serverless.
Famous serverless GPUs providers
Still to be written: Google Cloud Platform, Hugging Face.
Further reading
Photo credits on this page
The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.
- Cloudflare: HaeB, CC BY-SA 4.0, source
- Groq: Avivweinstein, CC BY-SA 4.0, source