LLM Cluster · Live Metrics

—

connecting…
Status
–
Backends
–
Idle slots
–
Busy▾
–
Pending▾
–
Users▾
–
Served (total)▾
–
Utilization
–
 
Throughput
– req/s
– avg since poller start
Poll latency
– ms
avg – · peak –
Poller uptime
–
0 polls · 0 err
Busy backends–
Pending queue–
Concurrent users–
Requests / sec–
Poll latency (ms)–