Skip to content

Commit 1b1e8e0

Browse files
reidliu41reidliu41
and
reidliu41
authored
[doc] update env variable export (#18391)
Signed-off-by: reidliu41 <[email protected]> Co-authored-by: reidliu41 <[email protected]>
1 parent bca55b5 commit 1b1e8e0

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

docs/source/getting_started/quickstart.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -82,6 +82,11 @@ llm = LLM(model="facebook/opt-125m")
8282

8383
:::{note}
8484
By default, vLLM downloads models from [Hugging Face](https://huggingface.co/). If you would like to use models from [ModelScope](https://www.modelscope.cn), set the environment variable `VLLM_USE_MODELSCOPE` before initializing the engine.
85+
86+
```shell
87+
export VLLM_USE_MODELSCOPE=True
88+
```
89+
8590
:::
8691

8792
Now, the fun part! The outputs are generated using `llm.generate`. It adds the input prompts to the vLLM engine's waiting queue and executes the vLLM engine to generate the outputs with high throughput. The outputs are returned as a list of `RequestOutput` objects, which include all of the output tokens.

0 commit comments

Comments
 (0)