feature/metrics - #443

Open

klement wants to merge 9 commits into

theroyallab:mainfrom

klement:feature/metrics

Commits on Jul 31, 2026

API: Add opt-in Prometheus-compatible /metrics endpoint

Klement Sekera
and
claude
committed
9d61e78
API: Add KV cache metrics to /metrics endpoint

Klement Sekera
and
claude
committed
25e0314
API: Add prefix-cache counters, latency histograms and spec decode stats to /metrics

Klement Sekera
and
claude
committed
db7054e
API: Stop publishing prompt_tokens_seconds in /metrics

Klement Sekera
and
claude
committed
e17db62
API: Add tokens_predicted_max to /metrics

Klement Sekera
and
claude
committed
8c75400

Commits on Aug 1, 2026

API: Add KV offload cache gauges to /metrics

Klement Sekera
and
claude
committed
8b05929
API: Add recurrent checkpoint metrics to /metrics

Klement Sekera
and
claude
committed
e972669
API: Build token histogram buckets from the model's context length

Klement Sekera
and
claude
committed
ef44f6f
API: Publish process_start_time_seconds in /metrics

Klement Sekera
and
claude
committed
5b73894