whisper.cpp/ggml/src
Johannes Gäßler aaf3f39b4a llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653)
* llama: automatically fit args to free memory

llama-fit-params tool

* fix CI

* hints for bug reports, ensure no reallocation

* fix segfault with Vulkan

* add llama-fit-params to CI

* fix CI

* fix CI

* fix CI

* minor adjustments

* fix assignment of 1 dense layer

* fix logger not being reset on model load failure

* remove --n-gpu-layer hint on model load failure

* fix llama-fit-params verbosity

* fix edge case

* fix typo [no ci]
2025-12-18 08:20:56 +02:00
..
ggml-blas rename optimize_graph to graph_optimize (llama/16082) 2025-09-20 13:46:39 +03:00
ggml-cann cann : fix ops broken by circular padding guard (llama/17825) 2025-12-18 08:20:56 +02:00
ggml-cpu ggml : arm repack fix build (llama/0) 2025-12-18 08:20:56 +02:00
ggml-cuda CUDA: fix overflow in MMA kernel without stream-k (llama/17939) 2025-12-18 08:20:56 +02:00
ggml-hexagon ggml-hexagon: fix `rope` failure at `test-backend-ops` (llama/17565) 2025-12-12 17:53:24 +02:00
ggml-hip HIP: fix AMDGPU_TARGETS, update documentation (llama/16803) 2025-11-09 23:38:03 +02:00
ggml-metal metal: SSM kernel improvements (llama/17876) 2025-12-12 17:53:23 +02:00
ggml-musa CUDA: faster tile FA, add oob checks, more HSs (llama/16492) 2025-10-15 09:29:17 +03:00
ggml-opencl ggml : add circular tiling support to pad, for Vulkan, CUDA, and CPU (used for making seamless textures) (llama/16985) 2025-12-12 17:53:20 +02:00
ggml-rpc ggml : improve error handling for search path existence checks (llama/17653) 2025-12-12 17:53:20 +02:00
ggml-sycl Support gpt-oss by OPs add-id, mul_mat for mxfp4, swiglu_oai (llama/17826) 2025-12-18 08:20:56 +02:00
ggml-vulkan vulkan: fix mul_mat_vec_iq1_s formatting (llama/18026) 2025-12-18 08:20:56 +02:00
ggml-webgpu ggml webgpu: unary op suppport, code refactoring, ops support (llama/17764) 2025-12-12 17:53:18 +02:00
ggml-zdnn zdnn: refactor codebase + add docs (llama/16178) 2025-09-29 15:18:09 +03:00
ggml-zendnn ggml-zendnn : add ZenDNN backend for AMD CPUs (llama/17690) 2025-12-12 17:53:21 +02:00
CMakeLists.txt ggml-zendnn : add ZenDNN backend for AMD CPUs (llama/17690) 2025-12-12 17:53:21 +02:00
ggml-alloc.c llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653) 2025-12-18 08:20:56 +02:00
ggml-backend-impl.h rpc : add support for multiple devices (llama/16276) 2025-10-12 11:16:23 +03:00
ggml-backend-reg.cpp ggml-zendnn : add ZenDNN backend for AMD CPUs (llama/17690) 2025-12-12 17:53:21 +02:00
ggml-backend.cpp llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653) 2025-12-18 08:20:56 +02:00
ggml-common.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-impl.h ggml : add ops SOFTPLUS, EXPM1, TRI, SOLVE_TRI, CUMSUM (llama/17063) 2025-11-17 21:05:46 +02:00
ggml-opt.cpp finetune: SGD optimizer, more CLI args (llama/13873) 2025-08-18 20:30:45 +03:00
ggml-quants.c ggml : fix uninitialized is_on_grid in quantize_row_iq3_xxs_impl (llama/15928) 2025-09-29 15:18:09 +03:00
ggml-quants.h llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
ggml-threading.cpp ggml : build backends as libraries (llama/10256) 2024-11-20 21:00:08 +02:00
ggml-threading.h remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (llama/10797) 2024-12-18 12:52:16 +02:00
ggml.c llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (llama/16653) 2025-12-18 08:20:56 +02:00
ggml.cpp ggml : Print backtrace on uncaught C++ exceptions (ggml/1232) 2025-05-29 09:56:26 +03:00
gguf.cpp ggml : prevent integer overflow in gguf tensor size calculation (llama/14595) 2025-07-12 19:23:56 +03:00