kv cache quantization, cuda head size

[betweenus]

Hi. Please tell me if there is a way to assemble cores for cuda with a head size different from 128? For example, to be able to use quantization of the kv cache with gpu-acceleration for models like gemma-2, gemma-3 and others? People often suffer from similar problems, for example, like here #12624