public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml/src
History
ynankani 51319a2cd9 CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (llama/26843) 
* CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark

Signed-off-by: ynankani <ynankani@nvidia.com>

* skip moe experts and allow others based on k geometry (allow only small idle tail)

Signed-off-by: ynankani <ynankani@nvidia.com>

* rename MMVQ DGX Spark params to GB10 and fix MSVC constexpr lambda capture

Signed-off-by: ynankani <ynankani@nvidia.com>

---------

Signed-off-by: ynankani <ynankani@nvidia.com>
 		2026-08-18 15:33:21 +03:00
..
ggml-blas llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-cann llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-cpu ggml : recurrent state rollback for ggml_ssm_scan (llama/26623) 2026-08-14 22:16:06 +03:00
ggml-cuda CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (llama/26843) 2026-08-18 15:33:21 +03:00
ggml-et ggml : recurrent state rollback for ggml_ssm_scan (llama/26623) 2026-08-14 22:16:06 +03:00
ggml-hexagon llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-hip ggml-hip : remove -funsafe-math-optimizations (llama/26696) 2026-08-14 22:16:06 +03:00
ggml-metal ggml : recurrent state rollback for ggml_ssm_scan (llama/26623) 2026-08-14 22:16:06 +03:00
ggml-musa ggml-cuda: native bf16 flash attention for vec kernel (llama/20525) 2026-03-29 15:04:36 +03:00
ggml-opencl opencl: default FA c8 cluster width to 16 on X1E (llama/26433) 2026-08-14 22:16:06 +03:00
ggml-openvino OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (llama/26952) 2026-08-14 22:16:06 +03:00
ggml-rpc llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-sycl sycl: fix thread/block count in quantized cpy kernel launches (llama/27160) 2026-08-18 15:33:21 +03:00
ggml-virtgpu llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-vulkan vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat1 on Intel Xe (llama/25380) 2026-08-18 15:33:21 +03:00
ggml-webgpu ggml : recurrent state rollback for ggml_ssm_scan (llama/26623) 2026-08-14 22:16:06 +03:00
ggml-zdnn llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-zendnn llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
CMakeLists.txt sync : ggml (#3962) 2026-07-31 09:11:28 +02:00
ggml-alloc.c ggml-alloc: fix out-of-bounds read in ggml_dyn_tallocr_remove_block (ggml/1492) 2026-05-25 12:26:07 +03:00
ggml-backend-dl.cpp hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-dl.h hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-impl.h ggml: backend-agnostic tensor parallelism (experimental) (llama/19378) 2026-04-30 11:29:05 +03:00
ggml-backend-meta.cpp llama: add default load-mode auto, which avoids mmap on iGPUs (llama/26081) 2026-08-14 22:16:06 +03:00
ggml-backend-reg.cpp sync : ggml (#3962) 2026-07-31 09:11:28 +02:00
ggml-backend.cpp ggml: use dynamic allocation for split graph inputs (llama/22789) 2026-08-04 13:37:47 +03:00
ggml-common.h Add Q2_0 quantization: type definition and CPU backend (llama/24448) 2026-07-10 13:06:42 +03:00
ggml-feats.h ggml : fix arm builds, unused var (llama/26991) 2026-08-14 22:16:06 +03:00
ggml-impl.h ggml: add graph_reused (llama/21764) 2026-04-30 11:29:11 +03:00
ggml-opt.cpp fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (llama/21592) 2026-04-30 11:29:03 +03:00
ggml-quants.c Add Q2_0 quantization: type definition and CPU backend (llama/24448) 2026-07-10 13:06:42 +03:00
ggml-quants.h Add Q2_0 quantization: type definition and CPU backend (llama/24448) 2026-07-10 13:06:42 +03:00
ggml-threading.cpp ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (llama/10797) 2024-12-18 12:52:16 +02:00
ggml.c ggml : recurrent state rollback for ggml_ssm_scan (llama/26623) 2026-08-14 22:16:06 +03:00
ggml.cpp ggml : Print backtrace on uncaught C++ exceptions (ggml/1232) 2025-05-29 09:56:26 +03:00
gguf.cpp gguf : harden loader against malformed tensor dims and metadata types (llama/25596) 2026-08-14 22:16:06 +03:00