public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml
History
Titaniumtown 2aef2a0085 sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (llama/26779) 
Measured on Arc Pro B70 (Battlemage, Level Zero), llama-bench -r 20, two
interleaved rounds, tg128:

    qwen2.5-3B-Instruct Q4_K_M    154.18 -> 158.53 t/s   +2.8%
    gemma-2-2b-it Q4_K_M          162.45 -> 165.62 t/s   +2.0%

llama-batched-bench on qwen2.5-3B, S_TG by batch size:

      B=1   142.72 -> 147.57 t/s    +3.4%
      B=2   243.72 -> 268.26 t/s   +10.1%
      B=4   359.58 -> 398.02 t/s   +10.7%
      B=8   449.75 -> 505.63 t/s   +12.4%
 		2026-08-14 22:16:06 +03:00
..
cmake cmake : add config version support (ggml/1582) 2026-08-14 22:16:06 +03:00
include llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
src sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (llama/26779) 2026-08-14 22:16:06 +03:00
.gitignore
…
CMakeLists.txt cmake : add config version support (ggml/1582) 2026-08-14 22:16:06 +03:00