public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml/src
History
Max Krasnyansky e6476d4c12 hexagon: further optimizations and refactoring for flash attention (llama/19583) 
* ggml-hexagon: fa improvements

ggml-hexagon: optimize flash attention calculations with improved variable handling

ggml-hexagon: streamline flash attention operations by removing redundant checks for FP32

ggml-hexagon: optimize hvx_dot_f16_f16_aa_rx2 by simplifying variable handling for unused elements

ggml-hexagon: optimize flash attention by changing slope vector type to F16

* hexfa: fixed test-backend-ops failurs due to leftover element handling

* hexagon: refactor and optimize fa to use local context struct

* ggml-hexagon: optimize flash-attention using hvx_vec_expf

Use HVX for online softmax.

---------

Co-authored-by: chraac <chraac@gmail.com>
 		2026-02-15 21:44:37 +02:00
..
ggml-blas ggml : add ggml_build_forward_select (llama/18550) 2026-01-30 15:56:40 +02:00
ggml-cann CANN: Remove unnecessary wrapper for `gml_backend_buft_is_cann` (llama/18968) 2026-02-15 21:44:37 +02:00
ggml-cpu Fix wrong memcpy length for block_interleave == 4 (llama/19575) 2026-02-15 21:44:37 +02:00
ggml-cuda fix vulkan ggml_acc only works in 3d but not 4d (llama/19426) 2026-02-15 21:44:37 +02:00
ggml-hexagon hexagon: further optimizations and refactoring for flash attention (llama/19583) 2026-02-15 21:44:37 +02:00
ggml-hip HIP: add mmf for CDNA (llama/18896) 2026-01-30 15:56:40 +02:00
ggml-metal metal : improve concurrency (llama/19555) 2026-02-15 21:44:37 +02:00
ggml-musa CUDA: faster tile FA, add oob checks, more HSs (llama/16492) 2025-10-15 09:29:17 +03:00
ggml-opencl opencl: add basic support for q4_1 (llama/19534) 2026-02-15 21:44:37 +02:00
ggml-rpc rpc : use unordered_map::reserve and emplace (llama/18513) 2026-01-14 09:11:59 +02:00
ggml-sycl sycl: add F16 support for GGML_OP_CEIL (llama/19306) 2026-02-08 09:29:10 +02:00
ggml-virtgpu ggml-virtgpu: make the code thread safe (llama/19204) 2026-02-08 09:29:10 +02:00
ggml-vulkan vulkan: restore -inf check in FA shaders (llama/19582) 2026-02-15 21:44:37 +02:00
ggml-webgpu Plug memory leaks and free resources on shutdown (llama/19315) 2026-02-15 21:44:37 +02:00
ggml-zdnn ggml-zdnn : mark zDNN buffers as non-host (llama/18967) 2026-01-30 15:56:40 +02:00
ggml-zendnn ggml-zendnn : resolve ZenDNN backend cross-module symbol dependency (llama/19159) 2026-01-30 15:56:40 +02:00
CMakeLists.txt hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-alloc.c llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653) 2025-12-18 08:20:56 +02:00
ggml-backend-dl.cpp hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-dl.h hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-impl.h llama: use host memory if device reports 0 memory (llama/18587) 2026-01-14 09:11:59 +02:00
ggml-backend-reg.cpp ggml : use noexcept overload for is_regular_file in backend registration (llama/19452) 2026-02-15 21:44:37 +02:00
ggml-backend.cpp ggml-backend: fix async set/get fallback sync (llama/19179) 2026-02-08 09:29:10 +02:00
ggml-common.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-impl.h ggml : add ggml_build_forward_select (llama/18550) 2026-01-30 15:56:40 +02:00
ggml-opt.cpp finetune: SGD optimizer, more CLI args (llama/13873) 2025-08-18 20:30:45 +03:00
ggml-quants.c ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (llama/15928) 2025-09-29 15:18:09 +03:00
ggml-quants.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-threading.cpp ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (llama/10797) 2024-12-18 12:52:16 +02:00
ggml.c ggml : unary ops support non-cont src0 + metal F16 unary ops (llama/19511) 2026-02-15 21:44:37 +02:00
ggml.cpp ggml : Print backtrace on uncaught C++ exceptions (ggml/1232) 2025-05-29 09:56:26 +03:00
gguf.cpp ggml : prevent integer overflow in gguf tensor size calculation (llama/14595) 2025-07-12 19:23:56 +03:00