whisper.cpp/ggml/src
Alberto Cabrera Pérez 45d8b2352e sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (llama/12858)
* sycl : Implemented reorder Q4_0 mmvq

Signed-off-by: Alberto Cabrera <alberto.cabrera@codeplay.com>

* sycl : Fixed mmvq being called when reorder is disabled

* sycl : Improved comments in the quants header

Signed-off-by: Alberto Cabrera <alberto.cabrera@codeplay.com>

* Use static_assert

* safe_div -> ceil_div

* Clarify qi comment

* change the reorder tensor from init to execute OP

* dbg

* Undo changes to test-backend-ops

* Refactor changes on top of q4_0 reorder fix

* Missing Reverts

* Refactored opt_for_reorder logic to simplify code path

* Explicit inlining and unroll

* Renamed mul_mat_algo enum for consistency

---------

Signed-off-by: Alberto Cabrera <alberto.cabrera@codeplay.com>
Co-authored-by: romain.biessy <romain.biessy@codeplay.com>
2025-05-13 13:59:21 +03:00
..
ggml-amx
ggml-blas
ggml-cann CANN: Add support for async operator submission (llama/12864) 2025-04-24 20:39:16 +03:00
ggml-cpu rpc : use backend registry, support dl backends (llama/13304) 2025-05-07 21:00:32 +03:00
ggml-cuda CUDA: FA support for Deepseek (Ampere or newer) (llama/13306) 2025-05-13 13:59:21 +03:00
ggml-hip CUDA/HIP: Share the same unified memory allocation logic. (llama/12934) 2025-04-24 20:39:16 +03:00
ggml-kompute
ggml-metal metal : fix floating-point range of attention scores in FA kernels (llama/13090) 2025-04-24 20:39:16 +03:00
ggml-musa cuda : enable CUDA Graph on CUDA Toolkit < 12.x (llama/12394) 2025-03-27 11:06:03 +02:00
ggml-opencl opencl : remove obsolete files (skip) (ggml/1200) 2025-04-24 20:39:16 +03:00
ggml-rpc rpc : add rpc_msg_set_tensor_hash_req (llama/13353) 2025-05-13 13:59:21 +03:00
ggml-sycl sycl : implementation of reordered Q4_0 MMVQ for Intel GPUs (llama/12858) 2025-05-13 13:59:21 +03:00
ggml-vulkan vulkan: Allow up to 4096 elements for mul_mat_id row_ids (llama/13326) 2025-05-13 13:59:21 +03:00
CMakeLists.txt cmake : removed stdc++fs (#3097) 2025-05-02 12:41:35 +03:00
ggml-alloc.c ggml: Don't assert fail when tensor data changes (llama/13222) 2025-05-07 15:39:32 +03:00
ggml-backend-impl.h
ggml-backend-reg.cpp
ggml-backend.cpp CUDA: fix logic for clearing padding with -ngl 0 (llama/13320) 2025-05-07 21:00:32 +03:00
ggml-common.h musa: fix all warnings, re-enable `-DLLAMA_FATAL_WARNINGS=ON` in ci and update doc (llama/12611) 2025-03-31 14:56:53 +03:00
ggml-impl.h ggml-impl.h: fix build on POWER9 (llama/12855) 2025-04-24 20:39:16 +03:00
ggml-opt.cpp
ggml-quants.c whisper: remove MSVC warnings pragmas (#3090) 2025-05-05 13:09:35 +02:00
ggml-quants.h
ggml-threading.cpp
ggml-threading.h
ggml.c CUDA: fix bad asserts for partial offload (llama/13337) 2025-05-07 21:00:32 +03:00
gguf.cpp Fix clang warning in gguf_check_reserved_keys (llama/12686) 2025-04-02 15:51:57 +03:00