Skip to content

Commit 274d8e8

Browse files
authored
[V1][Minor] Enhance SpecDecoding Metrics Log in V1 (#15902)
Signed-off-by: Woosuk Kwon <[email protected]>
1 parent 2039c63 commit 274d8e8

File tree

1 file changed

+10
-7
lines changed

1 file changed

+10
-7
lines changed

vllm/v1/spec_decode/metrics.py

Lines changed: 10 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -47,13 +47,16 @@ def log(self):
4747
num_draft_tokens = np.sum(self.num_draft_tokens)
4848
num_accepted_tokens = np.sum(self.num_accepted_tokens)
4949

50-
draft_acceptance_rate = (num_accepted_tokens / num_draft_tokens
51-
if num_draft_tokens > 0 else float("nan"))
50+
draft_acceptance_rate = (num_accepted_tokens / num_draft_tokens *
51+
100 if num_draft_tokens > 0 else float("nan"))
5252

5353
logger.info(
54-
"Speculative metrics: "
55-
"Draft acceptance rate: %.3f, "
56-
"Number of accepted tokens: %d, "
57-
"Number of draft tokens: %d, ", draft_acceptance_rate,
58-
num_accepted_tokens, num_draft_tokens)
54+
"SpecDecoding metrics: "
55+
"Draft acceptance rate: %.1f%%, "
56+
"Accepted: %d tokens, "
57+
"Drafted: %d tokens",
58+
draft_acceptance_rate,
59+
num_accepted_tokens,
60+
num_draft_tokens,
61+
)
5962
self.reset()

0 commit comments

Comments
 (0)