Jeff Bolzand0cc4m 6835e0cf77 vulkan: Use larger workgroups for mul_mat_vec when M is small (llama/15355) ...

* vulkan: Use larger workgroups for mul_mat_vec when M is small

Also use subgroup instructions for (part of) the reduction when supported.
Without this, the more expensive reductions would eat into the benefits of
the larger workgroups.

* update heuristic for amd/intel

Co-authored-by: 0cc4m <picard12@live.de>

---------

Co-authored-by: 0cc4m <picard12@live.de>

2025-08-18 20:30:45 +03:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)

2025-08-18 20:30:45 +03:00

include

ggml: initial IBM zDNN backend (llama/14975)

2025-08-18 20:30:45 +03:00

src

vulkan: Use larger workgroups for mul_mat_vec when M is small (llama/15355)

2025-08-18 20:30:45 +03:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

ggml: initial IBM zDNN backend (llama/14975)

2025-08-18 20:30:45 +03:00