Ankit Khandelwal 8cc3ca48c3 vulkan: MOE aware mat_mul_id tile selection (llama/29182) ...

mut_mul_id selected its matmul tile with total token count.
For MoE dispatch grid the true N per workgroup is per-expert rows.
At pp128 on Sarvam 30B that is 6, not 128, so the picker took the l-tile for ~6 live rows.
Most workers in each group had nothing to do.
This wasted time. The slow part was 55% of the whole job.

2026-10-06 10:38:09 +03:00

..

cmake

Enables Windows ARM64 build with MSVC cl.exe (llama/28362)

2026-10-06 10:38:06 +03:00

include

sycl : fix compile warnings

2026-09-23 20:46:47 +03:00

src

vulkan: MOE aware mat_mul_id tile selection (llama/29182)

2026-10-06 10:38:09 +03:00

.gitignore

whisper : reorganize source code + improve CMake (#2256)

2024-06-26 19:34:09 +03:00

CMakeLists.txt

ggml : bump version to 0.25.3 (ggml/1645)

2026-10-06 10:34:32 +03:00