Alfredandngdxzy 17a4cb15b8 ggml-hexagon: Implement true Q8_0 quantization on Hexagon NPU for more accurate mixed-precision matmul operations (llama/17977) ...

* feat: implement real Q8_0

* feat: adding cmake option for configuring FP32 quantize group size

* typo: set() shall be used

---------

Co-authored-by: ngdxzy <zhenyu_xu@uri.edu>

2025-12-31 17:52:09 +02:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)

2025-08-18 20:30:45 +03:00

include

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653)

2025-12-18 08:20:56 +02:00

src

ggml-hexagon: Implement true Q8_0 quantization on Hexagon NPU for more accurate mixed-precision matmul operations (llama/17977)

2025-12-31 17:52:09 +02:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

ggml-hexagon: Implement true Q8_0 quantization on Hexagon NPU for more accurate mixed-precision matmul operations (llama/17977)

2025-12-31 17:52:09 +02:00