quantize : add support for K-quant types

This commit is contained in:
Georgi Gerganov
2023-11-16 16:18:24 +02:00
parent 848e54f3ad
commit bebf0da983
2 changed files with 17 additions and 24 deletions