public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml/src
History
Jeff Bolz 162bbe8220 vulkan: KHR_coopmat flash attention (llama/13506) 
This shader uses coopmat1 to do the Q*K^T multiply. The P*V multiply is more
difficult for various reasons so I haven't done it. Performance for this
shader is around 2.5x better than for the scalar shader when doing prompt
processing. Some of the benefit may be from other optimizations like staging
through shared memory, or splitting by rows.
 		2025-05-19 14:58:39 +03:00
..
ggml-amx ggml : adapt AMX to tensor->grad removal (llama/0) 2024-11-20 21:00:08 +02:00
ggml-blas ggml : add support for dynamic loading of backends (llama/10469) 2024-12-08 20:14:35 +02:00
ggml-cann CANN: Add support for async operator submission (llama/12864) 2025-04-24 20:39:16 +03:00
ggml-cpu ggml-cpu: Update KleidiAI to v1.6 and fix include directives (llama/13509) 2025-05-19 14:58:39 +03:00
ggml-cuda llama/ggml: add LLM training support (llama/10544) 2025-05-13 13:59:21 +03:00
ggml-hip CUDA/HIP: Share the same unified memory allocation logic. (llama/12934) 2025-04-24 20:39:16 +03:00
ggml-kompute llama : add Qwen2VL support + multimodal RoPE (llama/10361) 2024-12-18 12:52:16 +02:00
ggml-metal metal : use FA-vec kernel up to batch size 20 (llama/13496) 2025-05-19 14:58:39 +03:00
ggml-musa cuda : enable CUDA Graph on CUDA Toolkit < 12.x (llama/12394) 2025-03-27 11:06:03 +02:00
ggml-opencl opencl: remove unnecessary assert for `add` (llama/13257) 2025-05-13 13:59:21 +03:00
ggml-rpc rpc : add rpc_msg_set_tensor_hash_req (llama/13353) 2025-05-13 13:59:21 +03:00
ggml-sycl enable dpcpp nightly builds with libraries (llama/13406) 2025-05-13 13:59:21 +03:00
ggml-vulkan vulkan: KHR_coopmat flash attention (llama/13506) 2025-05-19 14:58:39 +03:00
CMakeLists.txt cmake : removed stdc++fs (#3097) 2025-05-02 12:41:35 +03:00
ggml-alloc.c ggml: Don't assert fail when tensor data changes (llama/13222) 2025-05-07 15:39:32 +03:00
ggml-backend-impl.h ggml : upgrade init_tensor API to return a ggml_status (llama/11854) 2025-03-08 15:13:01 +02:00
ggml-backend-reg.cpp ggml-backend : fix backend search path (llama/12330) 2025-03-27 11:06:03 +02:00
ggml-backend.cpp llama/ggml: add LLM training support (llama/10544) 2025-05-13 13:59:21 +03:00
ggml-common.h musa: fix all warnings, re-enable `-DLLAMA_FATAL_WARNINGS=ON` in ci and update doc (llama/12611) 2025-03-31 14:56:53 +03:00
ggml-impl.h ggml-impl.h: fix build on POWER9 (llama/12855) 2025-04-24 20:39:16 +03:00
ggml-opt.cpp mnist: fix segmentation fault (ggml/1227) 2025-05-19 14:58:39 +03:00
ggml-quants.c whisper: remove MSVC warnings pragmas (#3090) 2025-05-05 13:09:35 +02:00
ggml-quants.h ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.cpp ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (llama/10797) 2024-12-18 12:52:16 +02:00
ggml.c ggml : fix apple OS check in ggml_print_backtrace (ggml/1229) 2025-05-19 14:58:39 +03:00
gguf.cpp Fix clang warning in gguf_check_reserved_keys (llama/12686) 2025-04-02 15:51:57 +03:00