Skip to content

Commit 12131b7

Browse files
heheda12345mzusman
authored andcommitted
[BugFix] add more is not None check in VllmConfig.__post_init__ (vllm-project#12138)
Signed-off-by: Chen Zhang <[email protected]>
1 parent 70b96af commit 12131b7

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/config.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3174,7 +3174,8 @@ def __post_init__(self):
31743174

31753175
if self.compilation_config is None:
31763176
self.compilation_config = CompilationConfig()
3177-
if envs.VLLM_USE_V1 and not self.model_config.enforce_eager:
3177+
if envs.VLLM_USE_V1 and self.model_config is not None and \
3178+
not self.model_config.enforce_eager:
31783179
# NOTE(woosuk): Currently, we use inductor because the piecewise
31793180
# CUDA graphs do not work properly with the custom CUDA kernels.
31803181
# FIXME(woosuk): Disable inductor to reduce the compilation time

0 commit comments

Comments
 (0)