Dedicated Endpoints
AvailableYour model, on GPUs nobody else is using.
Deploy a catalog model or your own fine-tune on GPUs reserved for you, with predictable latency and no shared queue.
- Pricing
- $4.79 / GPU-hr
- Layer
- Inference
- Deploy
- Catalog models, Fine-tune checkpoints, Hugging Face repos, Uploaded weights, NVIDIA H200, AMD Instinct MI325X
Why Dedicated Endpoints
Predictable latency, no shared queue.
A dedicated endpoint serves one model on capacity reserved for you. You choose the hardware, the regions and the replica bounds, it scales between them, and traffic can stay off the public internet.
Any model
A catalog model, a fine-tune checkpoint, a Hugging Face repository and revision, or weights uploaded from a dataset bucket.
Autoscaling
Replicas scale between the minimum and maximum you set, against a concurrency target, with scale-to-zero if you want it.
Private networking
Keep traffic off the public internet, and allow only the keys and IP ranges you list.
How it works
Reserved serving capacity for one model, billed per GPU-hour.
In the console
Everything in one place.
Dedicated Endpoints lives in the LegionEdge cloud console, next to every other service in the workspace, under one account and one identity.
Pricing
$4.79 / GPU-hr
Dedicated endpoints are billed per GPU-hour for the GPUs their replicas run on.
- Reserved terms lower the hourly rate on MI325X capacity.
- Scale-to-zero is optional, so idle capacity can be released.
- The wizard shows a cost estimate before you deploy.
GPU rates
Regions
Related products
Pairs well with Dedicated Endpoints
- Available
Serverless Inference
Open models behind one OpenAI-compatible endpoint.
From $0.10 / 1M tokens - Available
Playground
Send a prompt to any model your workspace can reach.
Billed as inference - Preview
Model Deployments
Immutable deployments with instant promote and rollback.
Billed as inference or per GPU-hour