Skip to content

Commit 9ea7f1a

Browse files
authored
fix(regression): clone from reference items (#18662)
Signed-off-by: Aaron Pham <[email protected]>
1 parent 2807271 commit 9ea7f1a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/sequence.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1494,7 +1494,7 @@ def add_request(request_id: str, engine, params, **kwargs):
14941494
for i in range(original_params.n):
14951495
request_id_i = f"{request_id}_parallel_sample_{i}"
14961496
group.seq_id_to_index[request_id_i] = i
1497-
params = params.clone()
1497+
params = original_params.clone()
14981498
params.n = 1
14991499
if params.seed is not None:
15001500
params.seed += i

0 commit comments

Comments
 (0)