Skip to content

Commit 0e8d177

Browse files
committed
feat: allow guidance backend for V0
Signed-off-by: Travis Johnson <[email protected]>
1 parent a223a3f commit 0e8d177

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/model_executor/guided_decoding/__init__.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,9 @@
1919

2020
logger = init_logger(__name__)
2121

22-
SUPPORTED_GUIDED_DECODING_V0 = ["outlines", "lm-format-enforcer", "xgrammar"]
22+
SUPPORTED_GUIDED_DECODING_V0 = [
23+
"outlines", "lm-format-enforcer", "xgrammar", "guidance"
24+
]
2325
SUPPORTED_GUIDED_DECODING_V1 = ["xgrammar", "guidance", "auto"]
2426
SUPPORTED_GUIDED_DECODING = list(
2527
set(SUPPORTED_GUIDED_DECODING_V0 + SUPPORTED_GUIDED_DECODING_V1))

0 commit comments

Comments
 (0)