Jeff Bolz cea5f1c52f vulkan: optimize mul_mat for small values of N (llama/10991) ... Make the mul_mat_vec shaders support N>1 (as a spec constant, NUM_COLS) where the batch_strides are overloaded to hold the row strides. Put the loads from the B matrix in the innermost loop because it should cache better. Share some code for reducing the result values to memory in mul_mat_vec_base.		2025-01-04 10:45:01 +02:00
..
include	tts : add OuteTTS support (llama/10784)	2025-01-04 10:45:01 +02:00
src	vulkan: optimize mul_mat for small values of N (llama/10991)	2025-01-04 10:45:01 +02:00
.gitignore	whisper : reorganize source code + improve CMake (#2256)	2024-06-26 19:34:09 +03:00
CMakeLists.txt	ggml : fix arm build (llama/10890)	2025-01-04 10:45:01 +02:00