Serverless GPU
PreviewShip a GPU container. Pay for the seconds it runs.
Deploy a container image with a GPU from the canvas and get a URL. Instances start on demand, scale between the limits you set and stop when traffic does, so you pay only for the seconds they run.
- Pricing
- Per GPU-second
- Layer
- Compute
- Deploy
- Container images, Services, Jobs, Project canvas, Environment variables, Secrets
Why Serverless GPU
GPU capacity that follows your traffic.
A serverless GPU service is a container image with a GPU attached and a URL in front of it. Instances start when requests arrive, scale between the limits you set and stop when traffic does, so idle time costs nothing.
Scale to zero
Set minimum and maximum instances and concurrency per service.
From the canvas
Stage a service with your other resources and apply it in one changeset.
Per-second metering
GPU and vCPU time billed by the second it runs.
How it works
GPU containers that scale with requests, down to zero.
In the console
Everything in one place.
Serverless GPU lives in the LegionEdge cloud console, next to every other service in the workspace, under one account and one identity.
Pricing
Per GPU-second
Serverless GPU is metered by the second: GPU time and vCPU time for as long as instances run, and nothing while the service is scaled to zero.
- Keep a minimum of instances running for steady traffic, or let the service scale to zero.
- A service scaled to zero starts an instance when the next request arrives.
- Budgets and spend limits cover serverless usage too.
Related products
Pairs well with Serverless GPU
- Available
GPU Cloud
AMD MI325X and NVIDIA H200 by the hour or on reservation.
From $3.35 / GPU-hr - Preview
Dedicated Clusters
Private, interconnected GPU clusters for sustained workloads.
Custom quote - Preview
Sandboxes
Isolated, short-lived environments for developers and AI agents.
Per vCPU, memory and disk hour