public_git
/
whisper.cpp
mirror of https://github.com/ggml-org/whisper.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
whisper.cpp/ggml/src/ggml-cuda
History
Akarshan Biswas 2ba5e0cb47
CUDA: fix build error from ambiguous __half conversions in conv2d (llama/15690) 
* CUDA: fix build error from ambiguous __half conversions in conv2d

Building conv2d with half precision failed because `__half` defines
multiple implicit conversion operators (to float, int, short, etc.),
causing ambiguous overload resolution when multiplying with float.

Introduce a templated `to_float` helper that explicitly converts
`__half` via `__half2float`, while passing through float unchanged.
Use this helper in conv2d accumulation to ensure unambiguous and
correct promotion to float.

Fixes some build errors with half-precision kernels on CUDA.

ggml-ci

* CUDA: Replace custom to_float helper with unified ggml_cuda_cast and add half‑>float conversion

* CUDA: Add missing convert.cuh header

* CUDA: remove unnecessary extension in ggml_cuda_cast

* CUDA: Address review comment, remove second type template argument
 		2025-09-20 13:42:46 +03:00
..
template-instances llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
vendors CUDA: MoE helper in device code, better tile sizes (llama/15525) 2025-09-20 13:42:41 +03:00
CMakeLists.txt cuda: Add cublasLt_static linking when GGML_STATIC is enabled (llama/15622) 2025-09-20 13:42:43 +03:00
acc.cu llama/ggml: add LLM training support (llama/10544) 2025-05-13 13:59:21 +03:00
acc.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
add-id.cu musa: fix build warnings (llama/15258) 2025-09-20 13:42:38 +03:00
add-id.cuh llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
arange.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
arange.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
argmax.cu cuda : optimize argmax (llama/10441) 2024-12-08 20:14:35 +02:00
argmax.cuh ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980) 2024-10-05 15:23:51 +03:00
argsort.cu ggml : reduce hash table reset cost (llama/8698) 2024-08-08 22:48:46 +03:00
argsort.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
binbcast.cu CUDA: fix bug in rms_norm fusion (llama/15660) 2025-09-20 13:42:44 +03:00
binbcast.cuh CUDA: fuse adds, fuse add with rms norm (llama/15631) 2025-09-20 13:42:44 +03:00
clamp.cu cuda: unary ops as float + de-duplicate (ggml/1130) 2025-03-08 15:13:01 +02:00
clamp.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
common.cuh CUDA: return -1 for nonexistent compiled arch (llama/15587) 2025-09-20 13:42:42 +03:00
concat.cu musa: fix all warnings, re-enable `-DLLAMA_FATAL_WARNINGS=ON` in ci and update doc (llama/12611) 2025-03-31 14:56:53 +03:00
concat.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
conv-transpose-1d.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
conv-transpose-1d.cuh feat: cuda implementation for `ggml_conv_transpose_1d` (ggml/854) 2024-07-08 14:53:55 +03:00
conv2d-dw.cu CUDA: add conv_2d_dw (llama/14265) 2025-06-21 07:34:17 +03:00
conv2d-dw.cuh CUDA: add conv_2d_dw (llama/14265) 2025-06-21 07:34:17 +03:00
conv2d-transpose.cu CUDA: add conv_2d_transpose (llama/14287) 2025-06-21 07:34:17 +03:00
conv2d-transpose.cuh CUDA: add conv_2d_transpose (llama/14287) 2025-06-21 07:34:17 +03:00
conv2d.cu CUDA: fix build error from ambiguous __half conversions in conv2d (llama/15690) 2025-09-20 13:42:46 +03:00
conv2d.cuh CUDA: add conv2d (llama/15635) 2025-09-20 13:42:44 +03:00
convert.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
convert.cuh HIP: Cleanup hipification header (llama/15285) 2025-08-18 20:30:45 +03:00
count-equal.cu ggml: fix zero division in ‘dne’ calculation in CUDA COUNT_EQUAL operator when ‘ne’ is small (#10213) 2024-11-15 15:21:04 +02:00
count-equal.cuh ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980) 2024-10-05 15:23:51 +03:00
cp-async.cuh CUDA: FA support for Deepseek (Ampere or newer) (llama/13306) 2025-05-13 13:59:21 +03:00
cpy-utils.cuh HIP: Cleanup hipification header (llama/15285) 2025-08-18 20:30:45 +03:00
cpy.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
cpy.cuh ggml: Re-enable CUDA graphs in presence of CONT and DUP nodes (llama/12970) 2025-04-24 20:39:16 +03:00
cross-entropy-loss.cu CUDA: add dynamic shared mem to softmax, refactor general usage (llama/14497) 2025-07-12 19:23:56 +03:00
cross-entropy-loss.cuh ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-24 19:45:08 +03:00
dequantize.cuh CUDA: replace GGML_CUDA_F16 with CUDA arch checks (llama/15433) 2025-09-20 13:42:38 +03:00
diagmask.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
diagmask.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-common.cuh CUDA: refactor FA support/selection code (llama/15454) 2025-09-20 13:42:38 +03:00
fattn-mma-f16.cuh musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
fattn-tile-f16.cu CUDA: fix half2 -> half conversion for HIP (llama/15529) 2025-09-20 13:42:40 +03:00
fattn-tile-f16.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-tile-f32.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
fattn-tile-f32.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
fattn-vec-f16.cuh musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
fattn-vec-f32.cuh musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
fattn-wmma-f16.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
fattn-wmma-f16.cuh CUDA: use mma PTX instructions for FlashAttention (llama/11583) 2025-02-03 22:00:57 +02:00
fattn.cu CUDA: refactor FA support/selection code (llama/15454) 2025-09-20 13:42:38 +03:00
fattn.cuh CUDA: refactor FA support/selection code (llama/15454) 2025-09-20 13:42:38 +03:00
getrows.cu CUDA: replace GGML_CUDA_F16 with CUDA arch checks (llama/15433) 2025-09-20 13:42:38 +03:00
getrows.cuh CUDA: batched+noncont MMQ, refactor bs>1 MoE code (llama/13199) 2025-05-01 13:29:02 +03:00
ggml-cuda.cu CUDA: fix bug in rms_norm fusion (llama/15660) 2025-09-20 13:42:44 +03:00
gla.cu llama: add support for QRWKV6 model architecture (llama/11001) 2025-01-14 10:38:01 +02:00
gla.cuh llama: add support for QRWKV6 model architecture (llama/11001) 2025-01-14 10:38:01 +02:00
im2col.cu llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
im2col.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
mean.cu cuda : fix GGML_CUDA_GRAPHS=OFF (llama/15300) 2025-08-18 20:30:45 +03:00
mean.cuh CUDA: add mean operation (llama/14313) 2025-07-01 17:54:53 +03:00
mma.cuh musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
mmf.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
mmf.cuh CUDA: GEMM for FP32/FP16/BF16 and ne11 <= 16 (llama/15131) 2025-08-18 20:30:45 +03:00
mmq.cu CUDA: MoE helper in device code, better tile sizes (llama/15525) 2025-09-20 13:42:41 +03:00
mmq.cuh CUDA: MoE helper in device code, better tile sizes (llama/15525) 2025-09-20 13:42:41 +03:00
mmvf.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
mmvf.cuh CUDA: GEMM for FP32/FP16/BF16 and ne11 <= 16 (llama/15131) 2025-08-18 20:30:45 +03:00
mmvq.cu musa: add GGML_UNUSED_VARS (llama/15446) 2025-09-20 13:42:38 +03:00
mmvq.cuh CUDA: noncont MMVQ + batched bs1 MUL_MAT_ID (llama/13014) 2025-04-24 20:39:16 +03:00
norm.cu CUDA: fix bug in rms_norm fusion (llama/15660) 2025-09-20 13:42:44 +03:00
norm.cuh CUDA: fuse adds, fuse add with rms norm (llama/15631) 2025-09-20 13:42:44 +03:00
opt-step-adamw.cu ggml: new optimization interface (ggml/988) 2024-11-20 21:00:08 +02:00
opt-step-adamw.cuh ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-24 19:45:08 +03:00
opt-step-sgd.cu finetune: SGD optimizer, more CLI args (llama/13873) 2025-08-18 20:30:45 +03:00
opt-step-sgd.cuh finetune: SGD optimizer, more CLI args (llama/13873) 2025-08-18 20:30:45 +03:00
out-prod.cu CPU/CUDA: fix (GQA) mul mat back, add CUDA support (llama/11380) 2025-02-03 22:00:57 +02:00
out-prod.cuh ggml/examples: add backend support for numerical optimization (ggml/949) 2024-09-24 19:45:08 +03:00
pad.cu musa: fix all warnings, re-enable `-DLLAMA_FATAL_WARNINGS=ON` in ci and update doc (llama/12611) 2025-03-31 14:56:53 +03:00
pad.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pad_reflect_1d.cu cuda : add Pad Reflect 1D support (llama/14659) 2025-09-20 13:42:39 +03:00
pad_reflect_1d.cuh cuda : add Pad Reflect 1D support (llama/14659) 2025-09-20 13:42:39 +03:00
pool2d.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
pool2d.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
quantize.cu CUDA: fix crash on large batch size for quant. MoE (llama/13537) 2025-05-19 14:58:39 +03:00
quantize.cuh CUDA: batched+noncont MMQ, refactor bs>1 MoE code (llama/13199) 2025-05-01 13:29:02 +03:00
reduce_rows.cuh musa: fix build warnings (llama/15258) 2025-09-20 13:42:38 +03:00
roll.cu CUDA: add roll (llama/14919) 2025-08-18 20:30:45 +03:00
roll.cuh CUDA: add roll (llama/14919) 2025-08-18 20:30:45 +03:00
rope.cu cuda : fix rope with partial rotation and non-cont src (llama/14580) 2025-07-12 19:23:56 +03:00
rope.cuh RoPE: fix back, CUDA support for back + noncont. (llama/11240) 2025-02-03 22:00:57 +02:00
scale.cu ggml : add ggml_scale_bias (llama/14417) 2025-07-12 19:23:56 +03:00
scale.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
set-rows.cu HIP: Cleanup hipification header (llama/15285) 2025-08-18 20:30:45 +03:00
set-rows.cuh CUDA: add set rows for f32 and f16 (llama/14551) 2025-07-20 00:23:50 +03:00
softcap.cu cuda : add softcap fusion (llama/14907) 2025-08-18 20:30:45 +03:00
softcap.cuh cuda : add softcap fusion (llama/14907) 2025-08-18 20:30:45 +03:00
softmax.cu llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
softmax.cuh CUDA: backwards pass for misc. ops, add tests (llama/11257) 2025-02-03 22:00:57 +02:00
ssm-conv.cu model : support LiquidAI LFM2 hybrid family (llama/14620) 2025-07-12 19:23:56 +03:00
ssm-conv.cuh ggml : faster ssm scan (llama/10558) 2025-04-02 15:51:57 +03:00
ssm-scan.cu ggml : fix SSM_SCAN for n_groups > 1 (llama/15625) 2025-09-20 13:42:43 +03:00
ssm-scan.cuh ggml : faster ssm scan (llama/10558) 2025-04-02 15:51:57 +03:00
sum.cu CUDA: Optimize `reduce_rows_f32` kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132) 2025-08-18 20:30:45 +03:00
sum.cuh tests: add gradient tests for all backends (ggml/932) 2024-09-24 19:45:08 +03:00
sumrows.cu CUDA: Optimize `reduce_rows_f32` kernel, leading up to 25x perf improvement on kernel-level and 10% perf increase for Gemma3n (llama/15132) 2025-08-18 20:30:45 +03:00
sumrows.cuh CUDA: add mean operation (llama/14313) 2025-07-01 17:54:53 +03:00
tsembd.cu whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
tsembd.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
unary.cu llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
unary.cuh llama : add gpt-oss (llama/15091) 2025-08-18 20:30:45 +03:00
upscale.cu CUDA: add bilinear interpolation for upscale (llama/14563) 2025-07-12 19:23:56 +03:00
upscale.cuh whisper : reorganize source code + improve CMake (#2256) 2024-06-26 19:34:09 +03:00
vecdotq.cuh CUDA: Accelerate MXFP4 table lookup using `__byte_perm` (llama/15451) 2025-09-20 13:42:41 +03:00
wkv.cu llama: Add support for RWKV v7 architecture (llama/12412) 2025-03-27 11:06:03 +02:00
wkv.cuh llama: Add support for RWKV v7 architecture (llama/12412) 2025-03-27 11:06:03 +02:00