Skip to content

Commit 9ab7161

Browse files
ywang96mzusman
authored andcommitted
[V1][Bugfix] Fix assertion when mm hashing is turned off (vllm-project#12439)
Signed-off-by: Roger Wang <[email protected]>
1 parent bdf42bf commit 9ab7161

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/v1/request.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -58,7 +58,8 @@ def __init__(
5858

5959
# Sanity check
6060
assert len(self.mm_inputs) == len(self.mm_positions)
61-
assert len(self.mm_inputs) == len(self.mm_hashes)
61+
if self.mm_hashes:
62+
assert len(self.mm_inputs) == len(self.mm_hashes)
6263

6364
# Cache the computed kv block hashes of the request to avoid
6465
# recomputing.

0 commit comments

Comments
 (0)