kurquharandMax Krasnyansky 7eea51881e hexagon: support tiled Q4_0 and Q8_0 GET_ROWS (llama/29511) ...

* hexagon: support tiled Q4_0 and Q8_0 GET_ROWS

* hex-get-rows: fix macros

* hex-get-rows: use tiled HVX dequantization

Assisted-by: OpenCode

* hex-get-rows: fix register spills and clean up checks for unsupported ops

* hex-get-rows: improve dma pipeline

* hex-get-rows: improve/simplify kernel selection logic

* hex-build: reenable vectorizer, didnt notice the regression earlier in the sampler update

---------

Co-authored-by: Max Krasnyansky <maxk@qti.qualcomm.com>

2026-10-06 10:38:04 +03:00

..

ggml-blas

llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081)

2026-08-14 22:16:06 +03:00

ggml-cann

ggml: add SWIGLU_CLAMP (llama/27930)

2026-09-04 13:39:35 +03:00

ggml-cpu

ggml-cpu: tiled mul_mat for k-quants (llama/27851)

2026-10-06 10:38:04 +03:00

ggml-cuda

cuda: support Nemotron 3 Puzzle state size 96 for ssm scan (llama/28717)

2026-10-06 10:38:04 +03:00

ggml-et

ggml: add SWIGLU_CLAMP (llama/27930)

2026-09-04 13:39:35 +03:00

ggml-hexagon

hexagon: support tiled Q4_0 and Q8_0 GET_ROWS (llama/29511)

2026-10-06 10:38:04 +03:00

ggml-hip

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (llama/28079)

2026-09-14 20:45:06 +03:00

ggml-metal

metal: FWHT kernels for block widths above 512 (llama/29095)

2026-10-06 10:38:03 +03:00

ggml-musa

CUDA: replace GGML_FA_ALL_QUANTS with GGML_FA_QUANTS, more control over what is compiled (llama/28079)

2026-09-14 20:45:06 +03:00

ggml-opencl

opencl: add A8 Q8_0 non-MoE dp4a binary kernel (llama/29439)

2026-10-06 10:38:04 +03:00

ggml-openvino

openvino : Update OpenVINO to 2026.4;fix clangd,MSVC warnings; (llama/29009)

2026-09-23 20:46:47 +03:00

ggml-rpc

rpc: include nb in the get_alloc_size cache key and floor the result at ggml_nbytes (llama/29283)

2026-10-06 10:34:34 +03:00

ggml-sycl

support sparse FA (llama/28796)

2026-10-06 10:34:34 +03:00

ggml-virtgpu

ggml: allow passing alloc dependencies in graph_optimize (llama/27301)

2026-09-04 13:39:33 +03:00

ggml-vulkan

Fixing the vulkan build issue of legacy GLSLC version that has no cooperativeMatrix API support (https://github.com/ggml-org/llama.cpp/issues/29373) (llama/29409)

2026-10-06 10:38:03 +03:00

ggml-webgpu

metal : gate mul_mm_id src1 rescale behind ggml_prec (llama/29029)

2026-09-23 20:46:47 +03:00

ggml-zdnn

llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081)

2026-08-14 22:16:06 +03:00

ggml-zendnn

CI: Use LLVM's OpenMP over MSVC_DEBUG_non_redist on Windows (llama/26678)

2026-08-21 19:23:26 +03:00

CMakeLists.txt

ggml : replace compile definitions with version.h.in (llama/28364)

2026-09-04 13:39:43 +03:00

ggml-alloc.c

ggml : fix ggml_clamp (llama/27644)

2026-08-25 15:28:56 +03:00

ggml-backend-dl.cpp

…

ggml-backend-dl.h

…

ggml-backend-impl.h

ggml : rename and make private ggml_op_alloc_size_may_expand() (ggml/0)

2026-09-04 13:39:43 +03:00

ggml-backend-meta.cpp

ggml-meta: resolve multi buffer views (llama/29266)

2026-09-23 20:46:47 +03:00

ggml-backend-reg.cpp

ggml : don't crash when backend search path can't be read (llama/28271)

2026-09-04 13:39:43 +03:00

ggml-backend.cpp

ggml : handle graph buffer reservation failure (llama/26070)

2026-09-23 20:46:47 +03:00

ggml-common.h

AVX2: Speed up large batch size prompt processing of IQ models (llama/27402)

2026-09-04 13:39:37 +03:00

ggml-feats.h

ggml : fix arm builds, unused var (llama/26991)

2026-08-14 22:16:06 +03:00

ggml-impl.h

ggml : update ggml_prec specification (llama/26675)

2026-09-14 20:45:06 +03:00

ggml-opt.cpp

…

ggml-quants.c

ggml : IQ1_M build prefix sums once per block (llama/28706)

2026-09-23 20:46:47 +03:00

ggml-quants.h

…

ggml-threading.cpp

…

ggml-threading.h

…

ggml-version.h.in

ggml : replace compile definitions with version.h.in (llama/28364)

2026-09-04 13:39:43 +03:00

ggml.c

ggml : fix ubsan error in ggml_graph_nbytes (ggml/1644)

2026-10-06 10:34:32 +03:00

ggml.cpp

…

gguf.cpp

gguf : align the data section relative to the GGUF start, not the file (llama/28993)

2026-09-23 20:46:47 +03:00