| .. |
|
template-instances
|
CUDA: faster FA for GQA > 1 but not power of 2 (llama/19092)
|
2026-01-30 15:56:40 +02:00 |
|
vendors
|
cuda : add RDNA4-specific MMVQ parameter table for bs=1 decode (llama/19478)
|
2026-03-16 13:10:15 +02:00 |
|
CMakeLists.txt
|
CUDA : Update CCCL-tag for 3.2 to final release from RC (llama/19486)
|
2026-02-15 21:44:37 +02:00 |
|
acc.cu
|
…
|
|
|
acc.cuh
|
…
|
|
|
add-id.cu
|
musa: fix build warnings (llama/15258)
|
2025-09-20 13:42:38 +03:00 |
|
add-id.cuh
|
llama : add gpt-oss (llama/15091)
|
2025-08-18 20:30:45 +03:00 |
|
arange.cu
|
…
|
|
|
arange.cuh
|
…
|
|
|
argmax.cu
|
ggml : use WARP_SIZE/2 for argmax reduction offset (llama/18092)
|
2025-12-18 08:20:56 +02:00 |
|
argmax.cuh
|
…
|
|
|
argsort.cu
|
CUDA: Fix builds for older CCCL versions by ifdefing strided_iterator (llama/18964)
|
2026-01-30 15:56:40 +02:00 |
|
argsort.cuh
|
sampling : add support for backend sampling (llama/17004)
|
2026-01-14 09:11:59 +02:00 |
|
binbcast.cu
|
ggml : extend bin bcast for permuted src1 (llama/19484)
|
2026-02-15 21:44:37 +02:00 |
|
binbcast.cuh
|
CUDA: fuse adds, fuse add with rms norm (llama/15631)
|
2025-09-20 13:42:44 +03:00 |
|
clamp.cu
|
…
|
|
|
clamp.cuh
|
…
|
|
|
common.cuh
|
Improve CUDA graph capture (llama/19754)
|
2026-02-27 20:57:58 +02:00 |
|
concat.cu
|
…
|
|
|
concat.cuh
|
…
|
|
|
conv-transpose-1d.cu
|
musa: add GGML_UNUSED_VARS (llama/15446)
|
2025-09-20 13:42:38 +03:00 |
|
conv-transpose-1d.cuh
|
…
|
|
|
conv2d-dw.cu
|
…
|
|
|
conv2d-dw.cuh
|
…
|
|
|
conv2d-transpose.cu
|
…
|
|
|
conv2d-transpose.cuh
|
…
|
|
|
conv2d.cu
|
CUDA: fix build error from ambiguous __half conversions in conv2d (llama/15690)
|
2025-09-20 13:42:46 +03:00 |
|
conv2d.cuh
|
CUDA: add conv2d (llama/15635)
|
2025-09-20 13:42:44 +03:00 |
|
convert.cu
|
cuda: cap grid.y at 65535 in non-contiguous dequantize/convert kernels (llama/19999)
|
2026-03-16 13:10:15 +02:00 |
|
convert.cuh
|
HIP: RDNA4 tensor core support for MMF (llama/17077)
|
2025-12-12 17:53:06 +02:00 |
|
count-equal.cu
|
…
|
|
|
count-equal.cuh
|
…
|
|
|
cp-async.cuh
|
…
|
|
|
cpy-utils.cuh
|
cuda : support non-contiguous i32 to i32 copy (llama/17326)
|
2025-12-12 17:53:06 +02:00 |
|
cpy.cu
|
Fix data race in CUDA's "cpy" kernel (influences GGML's DUP, CONT operations). (llama/20507)
|
2026-03-16 13:10:15 +02:00 |
|
cpy.cuh
|
cuda : remove legacy copy-op pointer indirection code (llama/16485)
|
2025-10-15 09:29:17 +03:00 |
|
cross-entropy-loss.cu
|
…
|
|
|
cross-entropy-loss.cuh
|
…
|
|
|
cumsum.cu
|
sampling : add support for backend sampling (llama/17004)
|
2026-01-14 09:11:59 +02:00 |
|
cumsum.cuh
|
Add support for CUMSUM and TRI for CUDA. (llama/17584)
|
2025-12-12 17:53:17 +02:00 |
|
dequantize.cuh
|
CUDA: replace GGML_CUDA_F16 with CUDA arch checks (llama/15433)
|
2025-09-20 13:42:38 +03:00 |
|
diag.cu
|
Add DIAG for CUDA (llama/17873)
|
2025-12-12 17:53:23 +02:00 |
|
diag.cuh
|
Add DIAG for CUDA (llama/17873)
|
2025-12-12 17:53:23 +02:00 |
|
diagmask.cu
|
…
|
|
|
diagmask.cuh
|
…
|
|
|
fattn-common.cuh
|
CUDA: limit number of FA stream-k CUDA blocks (llama/20586)
|
2026-03-16 13:10:15 +02:00 |
|
fattn-mma-f16.cuh
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
fattn-tile.cu
|
ggml: CUDA: add head size 72 for flash-attn (llama/16962)
|
2025-11-09 23:38:03 +02:00 |
|
fattn-tile.cuh
|
CUDA: fix kernel selection logic for tile FA (llama/19686)
|
2026-02-27 20:57:58 +02:00 |
|
fattn-vec.cuh
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
fattn-wmma-f16.cu
|
Adjust workaround for ROCWMMA_FATTN/GFX9 to only newer ROCm veresions (llama/19591)
|
2026-02-27 20:57:58 +02:00 |
|
fattn-wmma-f16.cuh
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
fattn.cu
|
CUDA: add CDNA3 MFMA support for flash attention MMA kernel (llama/19806)
|
2026-03-16 13:10:15 +02:00 |
|
fattn.cuh
|
CUDA: refactor FA support/selection code (llama/15454)
|
2025-09-20 13:42:38 +03:00 |
|
fill.cu
|
ggml : allow fill node alloc inplace (llama/17870)
|
2025-12-12 17:53:22 +02:00 |
|
fill.cuh
|
cuda : add FILL op support (llama/17851)
|
2025-12-12 17:53:22 +02:00 |
|
gated_delta_net.cu
|
CUDA: GDN hide memory latency (llama/20537)
|
2026-03-29 15:04:36 +03:00 |
|
gated_delta_net.cuh
|
ggml: add GATED_DELTA_NET op (llama/19504)
|
2026-03-16 13:10:15 +02:00 |
|
getrows.cu
|
CUDA: fix GET_ROWS for large tensors (llama/15882)
|
2025-09-20 13:42:52 +03:00 |
|
getrows.cuh
|
…
|
|
|
ggml-cuda.cu
|
ggml: avoid creating CUDA context during device init (llama/20595)
|
2026-03-16 13:10:15 +02:00 |
|
gla.cu
|
…
|
|
|
gla.cuh
|
…
|
|
|
im2col.cu
|
CUDA: fix im2col_3d to respect non-contiguous inputs (views) (llama/15956)
|
2025-09-20 13:45:30 +03:00 |
|
im2col.cuh
|
ggml: add ops for WAN video model (cuda && cpu) (llama/15669)
|
2025-09-20 13:42:49 +03:00 |
|
mean.cu
|
ggml-cuda: enable cuda-graphs for `n-cpu-moe` (llama/18934)
|
2026-01-30 15:56:40 +02:00 |
|
mean.cuh
|
…
|
|
|
mma.cuh
|
CUDA: add CDNA3 MFMA support for flash attention MMA kernel (llama/19806)
|
2026-03-16 13:10:15 +02:00 |
|
mmf.cu
|
HIP: add mmf for CDNA (llama/18896)
|
2026-01-30 15:56:40 +02:00 |
|
mmf.cuh
|
HIP: add mmf for CDNA (llama/18896)
|
2026-01-30 15:56:40 +02:00 |
|
mmid.cu
|
CUDA: add fp kernel for larger batch size MoE (llama/16512)
|
2025-10-15 09:29:17 +03:00 |
|
mmid.cuh
|
CUDA: add fp kernel for larger batch size MoE (llama/16512)
|
2025-10-15 09:29:17 +03:00 |
|
mmq.cu
|
HIP: adjust RDNA3.5 MMQ kernel selction logic (llama/18666)
|
2026-01-14 09:11:59 +02:00 |
|
mmq.cuh
|
cuda: optimize iq2xxs/iq2xs/iq3xxs dequantization (llama/19624)
|
2026-02-27 20:57:58 +02:00 |
|
mmvf.cu
|
CUDA: use mmvq for mul-mat-id for small batch sizes (llama/18958)
|
2026-02-08 09:29:10 +02:00 |
|
mmvf.cuh
|
CUDA: use mmvq for mul-mat-id for small batch sizes (llama/18958)
|
2026-02-08 09:29:10 +02:00 |
|
mmvq.cu
|
cuda : add RDNA4-specific MMVQ parameter table for bs=1 decode (llama/19478)
|
2026-03-16 13:10:15 +02:00 |
|
mmvq.cuh
|
cuda : enable CUDA graphs for MMID 1 <= BS <= 4 (llama/19645)
|
2026-02-27 20:57:58 +02:00 |
|
norm.cu
|
CUDA: Factor out and re-use `block_reduce` function (llama/18785)
|
2026-01-30 15:56:40 +02:00 |
|
norm.cuh
|
CUDA: fuse adds, fuse add with rms norm (llama/15631)
|
2025-09-20 13:42:44 +03:00 |
|
opt-step-adamw.cu
|
…
|
|
|
opt-step-adamw.cuh
|
…
|
|
|
opt-step-sgd.cu
|
finetune: SGD optimizer, more CLI args (llama/13873)
|
2025-08-18 20:30:45 +03:00 |
|
opt-step-sgd.cuh
|
finetune: SGD optimizer, more CLI args (llama/13873)
|
2025-08-18 20:30:45 +03:00 |
|
out-prod.cu
|
…
|
|
|
out-prod.cuh
|
…
|
|
|
pad.cu
|
cuda : extend GGML_OP_PAD to work with non-cont src0 (llama/19429)
|
2026-02-15 21:44:37 +02:00 |
|
pad.cuh
|
…
|
|
|
pad_reflect_1d.cu
|
musa: fix build warnings (llama/15611)
|
2025-09-29 15:18:10 +03:00 |
|
pad_reflect_1d.cuh
|
cuda : add Pad Reflect 1D support (llama/14659)
|
2025-09-20 13:42:39 +03:00 |
|
pool2d.cu
|
…
|
|
|
pool2d.cuh
|
…
|
|
|
quantize.cu
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
quantize.cuh
|
CUDA: experimental native mxfp4 support for blackwell (llama/17906)
|
2025-12-31 17:52:09 +02:00 |
|
reduce_rows.cuh
|
CUDA: Factor out and re-use `block_reduce` function (llama/18785)
|
2026-01-30 15:56:40 +02:00 |
|
roll.cu
|
…
|
|
|
roll.cuh
|
…
|
|
|
rope.cu
|
CUDA: Fix non-contig rope (llama/19338)
|
2026-02-15 21:44:37 +02:00 |
|
rope.cuh
|
CUDA: fuse rope + set_rows (llama/16884)
|
2025-11-17 21:05:46 +02:00 |
|
scale.cu
|
ggml: add ops for WAN video model (cuda && cpu) (llama/15669)
|
2025-09-20 13:42:49 +03:00 |
|
scale.cuh
|
…
|
|
|
set-rows.cu
|
CUDA: use fastdiv in set-rows (llama/16834)
|
2025-11-09 23:38:03 +02:00 |
|
set-rows.cuh
|
…
|
|
|
set.cu
|
cuda: add SET operation support (llama/16804)
|
2025-11-09 23:38:03 +02:00 |
|
set.cuh
|
cuda: add SET operation support (llama/16804)
|
2025-11-09 23:38:03 +02:00 |
|
softcap.cu
|
…
|
|
|
softcap.cuh
|
…
|
|
|
softmax.cu
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
softmax.cuh
|
…
|
|
|
solve_tri.cu
|
chore : correct typos [no ci] (llama/20041)
|
2026-03-16 13:10:15 +02:00 |
|
solve_tri.cuh
|
SOLVE_TRI CUDA kernel for small matrices (llama/17457)
|
2025-12-12 17:53:11 +02:00 |
|
ssm-conv.cu
|
cuda/hip: fix loop unrolling in ssm-conv (llama/20369)
|
2026-03-16 13:10:15 +02:00 |
|
ssm-conv.cuh
|
CUDA: use shared mem for ssm_conv (llama/20128)
|
2026-03-16 13:10:15 +02:00 |
|
ssm-scan.cu
|
ggml : optimize cuda ssm_scan using warp-level reduction (llama/18505)
|
2026-01-14 09:11:59 +02:00 |
|
ssm-scan.cuh
|
…
|
|
|
sum.cu
|
CUDA: Optimize `reduce_rows_f32` kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132)
|
2025-08-18 20:30:45 +03:00 |
|
sum.cuh
|
…
|
|
|
sumrows.cu
|
CUDA: Optimize `reduce_rows_f32` kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132)
|
2025-08-18 20:30:45 +03:00 |
|
sumrows.cuh
|
…
|
|
|
top-k.cu
|
CUDA: Replace init_offsets kernel with iterators in cub-based argsort (llama/18930)
|
2026-01-30 15:56:40 +02:00 |
|
top-k.cuh
|
sampling : add support for backend sampling (llama/17004)
|
2026-01-14 09:11:59 +02:00 |
|
topk-moe.cu
|
ggml-cuda: add mem check for fusion (llama/19916)
|
2026-03-16 13:10:15 +02:00 |
|
topk-moe.cuh
|
CUDA: refactor topk-moe to enable more models (GLM 4.7, Nemotron etc.) (llama/19126)
|
2026-01-30 15:56:40 +02:00 |
|
tri.cu
|
Add support for CUMSUM and TRI for CUDA. (llama/17584)
|
2025-12-12 17:53:17 +02:00 |
|
tri.cuh
|
Add support for CUMSUM and TRI for CUDA. (llama/17584)
|
2025-12-12 17:53:17 +02:00 |
|
tsembd.cu
|
ggml : fix padding in timestep embedding kernels (llama/15932)
|
2025-09-20 13:45:30 +03:00 |
|
tsembd.cuh
|
…
|
|
|
unary.cu
|
CUDA: use shared mem for ssm_conv (llama/20128)
|
2026-03-16 13:10:15 +02:00 |
|
unary.cuh
|
CUDA: use shared mem for ssm_conv (llama/20128)
|
2026-03-16 13:10:15 +02:00 |
|
upscale.cu
|
model: LFM2-VL fixes (llama/17577)
|
2025-12-12 17:53:14 +02:00 |
|
upscale.cuh
|
…
|
|
|
vecdotq.cuh
|
cuda: optimize iq2xxs/iq2xs/iq3xxs dequantization (llama/19624)
|
2026-02-27 20:57:58 +02:00 |
|
wkv.cu
|
…
|
|
|
wkv.cuh
|
…
|
|
dae7781052