4 people 5635f4b5a9 ggml : process data in smaller chunks in CUDA ggml_top_k() and ggml_argsort() to reduce temporary buffers memory usage (llama/24776) ...

* ggml : process data in smaller chunks in CUDA ggml_top_k() implementation to reduce temporary buffers memory usage

* ggml : allocate tmp_dst only only once before the loop

* chore : whitespaces

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* ggml : use chunked processing in both CUDA CUB top-k and argsort implementations

* chore : separate argsort_f32_i32_cuda_bitonic() call from return statement

Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

* chore : replace ternary operators with min/max

---------

Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: Johannes Gäßler <johannesg@5d6.de>

2026-07-30 16:31:36 +03:00

..

cmake

ggml : Parallelize quant LUT init (llama/23595)

2026-05-25 12:26:07 +03:00

include

Add Q2_0 quantization: type definition and CPU backend (llama/24448)

2026-07-10 13:06:42 +03:00

src

ggml : process data in smaller chunks in CUDA ggml_top_k() and ggml_argsort() to reduce temporary buffers memory usage (llama/24776)

2026-07-30 16:31:36 +03:00

.gitignore

…

CMakeLists.txt

ggml : bump version to 0.16.0 (ggml/1559)

2026-07-10 13:06:42 +03:00