Aman Gupta 8eede801e3 CUDA: use mmvq for mul-mat-id for small batch sizes (llama/18958) ...

* CUDA: use mmvq for mul-mat-id for small batch sizes

* add mmvq too

* Fix perf issue on ampere. Use mmvf mm-id only for non-nvidia GPUs

* templatize multi_token_path

2026-02-08 09:29:10 +02:00

..

cmake

cmake : remove unused file (ggml/1419)

2026-02-08 09:29:10 +02:00

include

ggml-cpu: FA split across kv for faster TG (llama/19209)

2026-02-08 09:29:10 +02:00

src

CUDA: use mmvq for mul-mat-id for small batch sizes (llama/18958)

2026-02-08 09:29:10 +02:00

.gitignore

…

CMakeLists.txt

Bump cmake max version (needed for Windows on Snapdragon builds) (llama/19188)

2026-02-08 09:29:10 +02:00