Skip to content

Commit 452049b

Browse files
committed
Fixed mistral tokenizer path when pointing to file
Signed-off-by: Pete Savage <[email protected]>
1 parent a5450f1 commit 452049b

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/transformers_utils/tokenizers/mistral.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -227,6 +227,7 @@ def from_pretrained(cls,
227227
else:
228228
assert Path(
229229
path_or_repo_id).is_file(), f"Invalid path: {path_or_repo_id}"
230+
tokenizer_file = str(Path(path_or_repo_id))
230231

231232
from mistral_common.tokens.tokenizers.mistral import (
232233
MistralTokenizer as PublicMistralTokenizer)

0 commit comments

Comments
 (0)