Chenguang Li 4d453b14a9 CANN: Add ROPE sin/cos cache for reuse (llama/15912) ... * CANN: Add ROPE sin/cos cache for reuse Introduce sin/cos caching mechanism in ROPE to avoid redundant computation across layers. The cache is built on the first layer per device and reused by subsequent layers if parameters match. - Added sin_cache / cos_cache pointers and position_length tracking - Introduced cache validity flags and properties: (ext_factor, theta_scale, freq_scale, attn_factor, is_neox) - Accelerates ROPE by eliminating repeated sin/cos generation This change reduces overhead in multi-layer scenarios while preserving correctness by verifying parameter consistency. Co-authored-by: hipudding <huafengchun@gmail.com> * fix typo Signed-off-by: noemotiovon <757486878@qq.com> --------- Signed-off-by: noemotiovon <757486878@qq.com> Co-authored-by: hipudding <huafengchun@gmail.com>		2025-09-20 13:42:53 +03:00
..
cmake	ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)	2025-08-18 20:30:45 +03:00
include	cuda : fix supports_op condition for get_rows when number of blocks is too large (llama/15868)	2025-09-20 13:42:52 +03:00
src	CANN: Add ROPE sin/cos cache for reuse (llama/15912)	2025-09-20 13:42:53 +03:00
.gitignore	whisper : reorganize source code + improve CMake (#2256)	2024-06-26 19:34:09 +03:00
CMakeLists.txt	ggml-cpu: drop support for nnpa intrinsics (llama/15821)	2025-09-20 13:42:50 +03:00