Skip to content

Commit 6e07e81

Browse files
terrytangyuanlulmer
authored andcommitted
Check if selected backend is None in get_attn_backend_cls() (vllm-project#12975)
Signed-off-by: Yuan Tang <[email protected]> Signed-off-by: Louis Ulmer <[email protected]>
1 parent a22ab35 commit 6e07e81

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/platforms/cpu.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ def get_attn_backend_cls(cls, selected_backend: _Backend, head_size: int,
3535
dtype: torch.dtype, kv_cache_dtype: Optional[str],
3636
block_size: int, use_v1: bool,
3737
use_mla: bool) -> str:
38-
if selected_backend != _Backend.TORCH_SDPA:
38+
if selected_backend and selected_backend != _Backend.TORCH_SDPA:
3939
logger.info("Cannot use %s backend on CPU.", selected_backend)
4040
logger.info("Using Torch SDPA backend.")
4141
return "vllm.attention.backends.torch_sdpa.TorchSDPABackend"

0 commit comments

Comments
 (0)