public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml/src
History
Adrien Gallouët b1b018dfd1 ggml : use a simple std::thread in AMX without OpenMP (llama/20074) 
Disabling OpenMP generally provides better inference performance (at
least in my testing) but the loading becomes slightly slower.

Benchmark results for `convert_B_packed_format()`:

Before this commit:

         N      K |  No OpenMP     OpenMP |    Diff |  Speedup
    ------------------------------------------------------------
       512   2880 |    640.9us    263.5us |  -58.9% |    0.41x
      2880   4096 |     2.55ms    261.7us |  -89.8% |    0.10x
    201088   2880 |   256.44ms    21.61ms |  -91.6% |    0.08x
    ------------------------------------------------------------

    Total: 325.43ms vs 31.05ms

After:

         N      K |  No OpenMP     OpenMP |    Diff |  Speedup
    ------------------------------------------------------------
       512   2880 |     1.49ms    263.5us |  -82.3% |    0.18x
      2880   4096 |     1.55ms    261.7us |  -83.1% |    0.17x
    201088   2880 |    24.03ms    21.61ms |  -10.1% |    0.90x
    ------------------------------------------------------------

    Total: 78.97ms vs 31.05ms

Tested with unsloth/gpt-oss-20b-GGUF:Q4_K_M.

Signed-off-by: Adrien Gallouët <angt@huggingface.co>
 		2026-03-16 13:10:15 +02:00
..
ggml-blas ggml : add ggml_build_forward_select (llama/18550) 2026-01-30 15:56:40 +02:00
ggml-cann CANN: Remove unnecessary wrapper for `gml_backend_buft_is_cann` (llama/18968) 2026-02-15 21:44:37 +02:00
ggml-cpu ggml : use a simple std::thread in AMX without OpenMP (llama/20074) 2026-03-16 13:10:15 +02:00
ggml-cuda cuda: cap grid.y at 65535 in non-contiguous dequantize/convert kernels (llama/19999) 2026-03-16 13:10:15 +02:00
ggml-hexagon hexagon refactor all Ops to use local context struct (llama/19819) 2026-02-27 20:57:58 +02:00
ggml-hip HIP: add mmf for CDNA (llama/18896) 2026-01-30 15:56:40 +02:00
ggml-metal models : optimize qwen3next graph (llama/19375) 2026-02-15 21:44:37 +02:00
ggml-musa CUDA: faster tile FA, add oob checks, more HSs (llama/16492) 2025-10-15 09:29:17 +03:00
ggml-opencl opencl: add optimized q4_1 mm kernel for adreno (llama/19840) 2026-03-16 13:10:15 +02:00
ggml-rpc rpc : use unordered_map::reserve and emplace (llama/18513) 2026-01-14 09:11:59 +02:00
ggml-sycl replace the magic nunber 768 by max work group size to support iGPU (llama/19920) 2026-02-27 20:57:58 +02:00
ggml-virtgpu ggml-virtgpu: improve the reliability of the code (llama/19846) 2026-02-27 20:57:58 +02:00
ggml-vulkan vulkan: tune MMVQ for Intel Windows (llama/19988) 2026-03-16 13:10:15 +02:00
ggml-webgpu ggml webgpu: fix workgroup dispatch limit for large batch sizes (llama/19965) 2026-03-16 13:10:15 +02:00
ggml-zdnn ggml-zdnn : mark zDNN buffers as non-host (llama/18967) 2026-01-30 15:56:40 +02:00
ggml-zendnn ggml-zendnn: update code for latest ZenDNN API (llama/19923) 2026-02-27 20:57:58 +02:00
CMakeLists.txt hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-alloc.c ggml : make `ggml_is_view` as API (llama/19539) 2026-02-27 20:57:58 +02:00
ggml-backend-dl.cpp hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-dl.h hexagon: enable offloading to Hexagon on Windows on Snapdragon (llama/19150) 2026-01-30 15:56:40 +02:00
ggml-backend-impl.h llama: use host memory if device reports 0 memory (llama/18587) 2026-01-14 09:11:59 +02:00
ggml-backend-reg.cpp ggml : use noexcept overload for is_regular_file in backend registration (llama/19452) 2026-02-15 21:44:37 +02:00
ggml-backend.cpp ggml-backend: fix async set/get fallback sync (llama/19179) 2026-02-08 09:29:10 +02:00
ggml-common.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-impl.h ggml : make `ggml_is_view` as API (llama/19539) 2026-02-27 20:57:58 +02:00
ggml-opt.cpp finetune: SGD optimizer, more CLI args (llama/13873) 2025-08-18 20:30:45 +03:00
ggml-quants.c ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (llama/15928) 2025-09-29 15:18:09 +03:00
ggml-quants.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-threading.cpp ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (llama/10797) 2024-12-18 12:52:16 +02:00
ggml.c ggml/gguf : prevent integer overflows (llama/19856) 2026-02-27 20:57:58 +02:00
ggml.cpp ggml : Print backtrace on uncaught C++ exceptions (ggml/1232) 2025-05-29 09:56:26 +03:00
gguf.cpp gguf : sync (ggml/0) 2026-02-27 20:57:58 +02:00