Skip to content

Commit 969da7d

Browse files
authored
[V1][VLM] Fix edge case bug for InternVL2 (#11165)
Signed-off-by: Roger Wang <[email protected]>
1 parent eeec9e3 commit 969da7d

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

vllm/model_executor/models/internvl.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -669,8 +669,11 @@ def _process_image_input(
669669
image_embeds = self.extract_feature(image_input["data"])
670670

671671
patches_per_image = image_input["patches_per_image"]
672+
673+
# Only one image in the current batch
672674
if len(patches_per_image) == 1:
673-
image_embeds = image_embeds.unsqueeze(0)
675+
image_embeds = image_embeds.view(
676+
-1, self.config.text_config.hidden_size).unsqueeze(0)
674677
return image_embeds
675678

676679
# NOTE: Image embeddings are split into separate tensors for each image

0 commit comments

Comments
 (0)