Skip to content

Commit d29ca3f

Browse files
NickLuccheMu Huai
authored and
Mu Huai
committed
[TPU][V1] Use language_model interface for getting text backbone in MM (vllm-project#16410)
Signed-off-by: NickLucche <[email protected]> Signed-off-by: Mu Huai <[email protected]>
1 parent a54d23e commit d29ca3f

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/v1/worker/tpu_model_runner.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -972,8 +972,7 @@ def initialize_kv_cache(self, kv_cache_config: KVCacheConfig) -> None:
972972

973973
def reset_dynamo_cache(self):
974974
if self.is_multimodal_model:
975-
assert hasattr(self.model, "language_model")
976-
compiled_model = self.model.language_model.model
975+
compiled_model = self.model.get_language_model().model
977976
else:
978977
compiled_model = self.model.model
979978
if isinstance(compiled_model, TorchCompileWrapperWithCustomDispatcher):

0 commit comments

Comments
 (0)