Skip to content

Commit 44769cf

Browse files
KuntaiDurasmith
authored andcommitted
[Bugfix] Fix a path bug in disaggregated prefill example script. (vllm-project#12121)
Signed-off-by: Kuntai Du <[email protected]>
1 parent 203e03c commit 44769cf

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

examples/online_serving/disaggregated_prefill.sh

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,8 @@
33
# We will launch 2 vllm instances (1 for prefill and 1 for decode),
44
# and then transfer the KV cache between them.
55

6+
set -xe
7+
68
echo "🚧🚧 Warning: The usage of disaggregated prefill is experimental and subject to change 🚧🚧"
79
sleep 1
810

@@ -69,7 +71,7 @@ wait_for_server 8200
6971
# instance
7072
# NOTE: the usage of this API is subject to change --- in the future we will
7173
# introduce "vllm connect" to connect between prefill and decode instances
72-
python3 ../benchmarks/disagg_benchmarks/disagg_prefill_proxy_server.py &
74+
python3 ../../benchmarks/disagg_benchmarks/disagg_prefill_proxy_server.py &
7375
sleep 1
7476

7577
# serve two example requests

0 commit comments

Comments
 (0)