Logs & Monitoring
AvailableWhen an endpoint misbehaves, see why.
Every inference request, training job and endpoint event in one searchable log, with dashboards for latency, tokens and errors.
- Pricing
- Included
- Layer
- Management & governance
- Collects from
- Serverless inference, Dedicated endpoints, Model deployments, Training jobs, GPU instances
Why Logs & Monitoring
Built into the request path, not bolted on.
Every inference request, training job and endpoint event lands in one searchable log. Tokens, latency and errors are recorded as requests are served, with log streams and traces at the endpoint level and dashboards across services.
Request logs
Every call with its model, status, key, latency and tokens. Filter by any of them, or switch on live tail.
Dashboards
Latency, throughput and error rates across services, broken down by deployment, region and key.
Limits & quotas
See the limits on your workspace and how close you are to each, and ask to raise one before you reach it.
How it works
Request logs, latency and error rates across services.
In the console
Everything in one place.
Logs & Monitoring lives in the LegionEdge cloud console, next to every other service in the workspace, under one account and one identity.
Pricing
Included
Logs & Monitoring is included in every workspace, on every plan.
- Prompts and responses are kept only when you turn payload logging on for a project, with a retention setting.
Related products