Skip to content

Commit d606cfd

Browse files
author
Yuqi Zhang
committed
Add half type support in reshape_and_cache_cpu_impl on x86 cpu platform
Signed-off-by: Yuqi Zhang <[email protected]>
1 parent a5450f1 commit d606cfd

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

csrc/cpu/cpu_types_x86.hpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -19,6 +19,7 @@ namespace vec_op {
1919
#define VLLM_DISPATCH_CASE_FLOATING_TYPES_FP8(...) \
2020
AT_DISPATCH_CASE(at::ScalarType::Float, __VA_ARGS__) \
2121
AT_DISPATCH_CASE(at::ScalarType::BFloat16, __VA_ARGS__) \
22+
AT_DISPATCH_CASE(at::ScalarType::Half, __VA_ARGS__) \
2223
AT_DISPATCH_CASE(at::ScalarType::Float8_e5m2, __VA_ARGS__)
2324

2425
#define VLLM_DISPATCH_FLOATING_TYPES(TYPE, NAME, ...) \

0 commit comments

Comments
 (0)