Skip to content

Commit d92a1b9

Browse files
jeejeeleelulmer
authored andcommitted
[Bugfix] Fix Qwen2_5_VLForConditionalGeneration packed_modules_mapping (vllm-project#12905)
Signed-off-by: Louis Ulmer <[email protected]>
1 parent f53c84d commit d92a1b9

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

vllm/model_executor/models/qwen2_5_vl.py

+5-2
Original file line numberDiff line numberDiff line change
@@ -760,9 +760,12 @@ class Qwen2_5_VLForConditionalGeneration(nn.Module, SupportsMultiModal,
760760
"q_proj",
761761
"k_proj",
762762
"v_proj",
763-
]
763+
],
764+
"gate_up_proj": [
765+
"gate_proj",
766+
"up_proj",
767+
],
764768
}
765-
766769
# LoRA specific attributes, TODO: double check
767770
supported_lora_modules = [
768771
"qkv_proj",

0 commit comments

Comments
 (0)