whisper.cpp/ggml/src/ggml-openvino
Gaurav Garg 868367609f Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (llama/25057)
* [CUDA] Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy

Add a CUDA ggml_cpy fast path for same-type, same-shape strided copies that are just 2D pitched block copies.
When tensors are not fully contiguous but each row is contiguous, it now uses cudaMemcpy2DAsync instead of the slow element-wise scalar copy kernel.

This fixes the GDN recurrent snapshot update with -np 4, where rollback slots are separated by cache stride gaps.

* Add new tests that execute the new optimized strided copy path

* Return unsupported for strided copy in OpenVINO, as new tests are failing
2026-07-10 13:06:42 +03:00
..
openvino openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (llama/24974) 2026-07-10 13:06:42 +03:00
.clang-format openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
CMakeLists.txt openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
ggml-decoder.cpp openvino: Update to OV 2026.2.1, self-contained release packages, operator improvements (llama/24974) 2026-07-10 13:06:42 +03:00
ggml-decoder.h openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
ggml-openvino-extra.cpp openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
ggml-openvino-extra.h openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
ggml-openvino.cpp Added a cudaMemcpy2DAsync fast path to ggml_cuda_cpy (llama/25057) 2026-07-10 13:06:42 +03:00
ggml-quants.cpp openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
ggml-quants.h openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
utils.cpp openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00
utils.h openvino: OV 2026.2, context-shift, Q5_1 support, gemma4 dense/embedding, and -fa off (llama/24503) 2026-06-19 12:53:43 +03:00