Jeff Bolz 939d3085e9 vulkan: Multi-pass softmax for large number of cols (llama/17892) ...

When the number of cols is large, split each row across multiple workgroups.
There are three phases that communicate partial results through temp buffers:
(1) compute max partials
(2) take max of partials, compute sum(exp(x-max)) partials
(3) sum partials, compute scaled result

2025-12-18 08:20:56 +02:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)

2025-08-18 20:30:45 +03:00

include

ggml-cpu : fix RISC-V Q4_0 repack select and RVV feature reporting (llama/17951)

2025-12-18 08:20:56 +02:00

src

vulkan: Multi-pass softmax for large number of cols (llama/17892)

2025-12-18 08:20:56 +02:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

cmake : set CMAKE_RUNTIME_OUTPUT_DIRECTORY for non standalone build (ggml/1394)

2025-12-12 17:53:24 +02:00