Skip to content

Commit 10611d8

Browse files
maleksan85maleksan85
authored andcommitted
[BUGFIX] When skip_tokenize_init and multistep are set, execution crashes (vllm-project#12277)
Signed-off-by: maleksan85 <[email protected]> Co-authored-by: maleksan85 <[email protected]>
1 parent 7980828 commit 10611d8

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/engine/output_processor/multi_step.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -144,7 +144,7 @@ def process_outputs(self,
144144
def _process_decode_and_stop(self, seq: Sequence,
145145
sampling_params: SamplingParams) -> None:
146146
new_char_count = 0
147-
if sampling_params.detokenize:
147+
if sampling_params.detokenize and self.detokenizer:
148148
new_char_count = self.detokenizer.decode_sequence_inplace(
149149
seq, sampling_params)
150150

0 commit comments

Comments
 (0)