Skip to content

Commit b7d3098

Browse files
authored
[V1] Update doc and examples for H2O-VL (#13349)
Signed-off-by: Roger Wang <[email protected]>
1 parent dc0f7cc commit b7d3098

File tree

3 files changed

+6
-7
lines changed

3 files changed

+6
-7
lines changed

docs/source/models/supported_models.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -726,7 +726,7 @@ See [this page](#generative-models) for more information on how to use generativ
726726
* `h2oai/h2ovl-mississippi-800m`, `h2oai/h2ovl-mississippi-2b`, etc.
727727
*
728728
* ✅︎
729-
* \*
729+
* ✅︎\*
730730
- * `Idefics3ForConditionalGeneration`
731731
* Idefics3
732732
* T + I
@@ -869,7 +869,7 @@ See [this page](#generative-models) for more information on how to use generativ
869869
<sup>+</sup> Multiple items can be inputted per text prompt for this modality.
870870

871871
:::{note}
872-
H2O-VL series models will be available in V1 once we support backends other than FlashAttention.
872+
`h2oai/h2ovl-mississippi-2b` will be available in V1 once we support backends other than FlashAttention.
873873
:::
874874

875875
:::{note}

examples/offline_inference/vision_language.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ def run_glm4v(question: str, modality: str):
119119
def run_h2ovl(question: str, modality: str):
120120
assert modality == "image"
121121

122-
model_name = "h2oai/h2ovl-mississippi-2b"
122+
model_name = "h2oai/h2ovl-mississippi-800m"
123123

124124
llm = LLM(
125125
model=model_name,
@@ -136,7 +136,7 @@ def run_h2ovl(question: str, modality: str):
136136
add_generation_prompt=True)
137137

138138
# Stop tokens for H2OVL-Mississippi
139-
# https://huggingface.co/h2oai/h2ovl-mississippi-2b
139+
# https://huggingface.co/h2oai/h2ovl-mississippi-800m
140140
stop_token_ids = [tokenizer.eos_token_id]
141141
return llm, prompt, stop_token_ids
142142

examples/offline_inference/vision_language_multi_image.py

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -78,14 +78,13 @@ def load_deepseek_vl2(question: str, image_urls: List[str]):
7878

7979

8080
def load_h2ovl(question: str, image_urls: List[str]) -> ModelRequestData:
81-
model_name = "h2oai/h2ovl-mississippi-2b"
81+
model_name = "h2oai/h2ovl-mississippi-800m"
8282

8383
llm = LLM(
8484
model=model_name,
8585
trust_remote_code=True,
8686
max_model_len=8192,
8787
limit_mm_per_prompt={"image": len(image_urls)},
88-
mm_processor_kwargs={"max_dynamic_patch": 4},
8988
)
9089

9190
placeholders = "\n".join(f"Image-{i}: <image>\n"
@@ -99,7 +98,7 @@ def load_h2ovl(question: str, image_urls: List[str]) -> ModelRequestData:
9998
add_generation_prompt=True)
10099

101100
# Stop tokens for H2OVL-Mississippi
102-
# https://huggingface.co/h2oai/h2ovl-mississippi-2b
101+
# https://huggingface.co/h2oai/h2ovl-mississippi-800m
103102
stop_token_ids = [tokenizer.eos_token_id]
104103

105104
return ModelRequestData(

0 commit comments

Comments
 (0)