Skip to content

Commit a72cd88

Browse files
psavMu Huai
authored and
Mu Huai
committed
[Bugfix] Fixed mistral tokenizer path when pointing to file (vllm-project#17457)
Signed-off-by: Pete Savage <[email protected]> Signed-off-by: Mu Huai <[email protected]>
1 parent f603f84 commit a72cd88

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/transformers_utils/tokenizers/mistral.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -227,6 +227,7 @@ def from_pretrained(cls,
227227
else:
228228
assert Path(
229229
path_or_repo_id).is_file(), f"Invalid path: {path_or_repo_id}"
230+
tokenizer_file = str(Path(path_or_repo_id))
230231

231232
from mistral_common.tokens.tokenizers.mistral import (
232233
MistralTokenizer as PublicMistralTokenizer)

0 commit comments

Comments
 (0)