Skip to content

Commit 69bff9b

Browse files
zhouzaidazhouzaida
and
zhouzaida
authored
fix float16 support for kimi-vl (#17156)
Co-authored-by: zhouzaida <[email protected]>
1 parent 41ca7eb commit 69bff9b

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

vllm/model_executor/models/kimi_vl.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -340,8 +340,7 @@ def _parse_and_validate_image_input(
340340
else:
341341
pixel_values = pixel_values.reshape(-1, num_channels, patch_size,
342342
patch_size)
343-
# fp32 -> bf16
344-
pixel_values = pixel_values.to(torch.bfloat16)
343+
pixel_values = pixel_values.to(self.vision_tower.dtype)
345344
# image_grid_hws.shape = (N, 2)
346345
assert image_grid_hws.ndim == 2, f"unexpected shape for image_grid_hws: {image_grid_hws.shape}"
347346

0 commit comments

Comments
 (0)