Skip to content

Commit 6b43f74

Browse files
committed
Update vllm/v1/worker/tpu_model_runner.py
Co-authored-by: Cyrus Leung <[email protected]> Signed-off-by: NickLucche <[email protected]>
1 parent 880614a commit 6b43f74

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/worker/tpu_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -972,7 +972,7 @@ def initialize_kv_cache(self, kv_cache_config: KVCacheConfig) -> None:
972972

973973
def reset_dynamo_cache(self):
974974
if self.is_multimodal_model:
975-
compiled_model = self.model.get_language_model()
975+
compiled_model = self.model.get_language_model().model
976976
else:
977977
compiled_model = self.model.model
978978
if isinstance(compiled_model, TorchCompileWrapperWithCustomDispatcher):

0 commit comments

Comments
 (0)