File tree Expand file tree Collapse file tree 2 files changed +6
-3
lines changed
vllm/model_executor/models Expand file tree Collapse file tree 2 files changed +6
-3
lines changed Original file line number Diff line number Diff line change @@ -277,7 +277,7 @@ Text Generation
277
277
* - :code: `QWenLMHeadModel `
278
278
- Qwen
279
279
- :code: `Qwen/Qwen-7B `, :code: `Qwen/Qwen-7B-Chat `, etc.
280
- -
280
+ - ✅︎
281
281
- ✅︎
282
282
* - :code: `Qwen2ForCausalLM `
283
283
- Qwen2
@@ -516,7 +516,7 @@ Text Generation
516
516
- Qwen-VL
517
517
- T + I\ :sup: `E+`
518
518
- :code: `Qwen/Qwen-VL `, :code: `Qwen/Qwen-VL-Chat `, etc.
519
- -
519
+ - ✅︎
520
520
- ✅︎
521
521
* - :code: `Qwen2AudioForConditionalGeneration `
522
522
- Qwen2-Audio
@@ -540,6 +540,9 @@ Text Generation
540
540
| :sup:`E` Pre-computed embeddings can be inputted for this modality.
541
541
| :sup:`+` Multiple items can be inputted per text prompt for this modality.
542
542
543
+ .. note ::
544
+ vLLM currently only supports adding LoRA to the language backbone of multimodal models.
545
+
543
546
.. note ::
544
547
For :code: `openbmb/MiniCPM-V-2 `, the official repo doesn't work yet, so we need to use a fork (:code: `HwwwH/MiniCPM-V-2 `) for now.
545
548
For more details, please see: https://github.com/vllm-project/vllm/pull/4087#issuecomment-2250397630
Original file line number Diff line number Diff line change @@ -1048,7 +1048,7 @@ def get_mm_mapping(self) -> MultiModelKeys:
1048
1048
@MULTIMODAL_REGISTRY .register_max_image_tokens (MAX_QWEN_IMG_TOKENS )
1049
1049
@INPUT_REGISTRY .register_dummy_data (dummy_data_for_qwen )
1050
1050
@INPUT_REGISTRY .register_input_processor (input_processor_for_qwen )
1051
- class QWenLMHeadModel (QWenBaseModel ):
1051
+ class QWenLMHeadModel (QWenBaseModel , SupportsLoRA ):
1052
1052
"""
1053
1053
QWenLMHeadModel is not only applicable to LLM but also to VL, which is not
1054
1054
conducive to the current integration logic of LoRA in vLLM. Therefore, it
You can’t perform that action at this time.
0 commit comments