Skip to content

Commit 9d98ab5

Browse files
[Misc] Inline Molmo requirements (vllm-project#17190)
Signed-off-by: DarkLight1337 <[email protected]>
1 parent df5c879 commit 9d98ab5

File tree

2 files changed

+27
-21
lines changed

2 files changed

+27
-21
lines changed

docs/source/models/supported_models.md

Lines changed: 27 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1112,7 +1112,33 @@ To use `TIGER-Lab/Mantis-8B-siglip-llama3`, you have to pass `--hf_overrides '{"
11121112
:::
11131113

11141114
:::{warning}
1115-
For improved output quality of `AllenAI/Molmo-7B-D-0924` (especially in object localization tasks), we recommend using the pinned dependency versions listed in <gh-file:requirements/molmo.txt> (including `vllm==0.7.0`). These versions match the environment that achieved consistent results on both A10 and L40 GPUs.
1115+
The output quality of `AllenAI/Molmo-7B-D-0924` (especially in object localization tasks) has deteriorated in recent updates.
1116+
1117+
For the best results, we recommend using the following dependency versions (tested on A10 and L40):
1118+
1119+
```text
1120+
# Core vLLM-compatible dependencies with Molmo accuracy setup (tested on L40)
1121+
torch==2.5.1
1122+
torchvision==0.20.1
1123+
transformers==4.48.1
1124+
tokenizers==0.21.0
1125+
tiktoken==0.7.0
1126+
vllm==0.7.0
1127+
1128+
# Optional but recommended for improved performance and stability
1129+
triton==3.1.0
1130+
xformers==0.0.28.post3
1131+
uvloop==0.21.0
1132+
protobuf==5.29.3
1133+
openai==1.60.2
1134+
opencv-python-headless==4.11.0.86
1135+
pillow==10.4.0
1136+
1137+
# Installed FlashAttention (for float16 only)
1138+
flash-attn>=2.5.6 # Not used in float32, but should be documented
1139+
```
1140+
1141+
**Note:** Make sure you understand the security implications of using outdated packages.
11161142
:::
11171143

11181144
:::{note}

requirements/molmo.txt

Lines changed: 0 additions & 20 deletions
This file was deleted.

0 commit comments

Comments
 (0)