whisper.cpp/ggml/src/ggml-cann
Chenguang Li 3780a3c917
CANN: Refactor ND to NZ workspace to be per-device (llama/15763)
* CANN:Refactor ND to NZ workspace to be per-device in Ascend backend

- Replaced the previous single global ND→NZ workspace with a per-device
  cache using unordered_map keyed by device ID.
- Functions `release_nz_workspace`, `relloc_nz_workspace`, and
  `get_nz_workspace` now manage workspace independently for each device,
  preventing memory conflicts in multi-device / pipeline parallel scenarios.
- This change fixes potential precision issues caused by workspace
  overwrites when multiple devices perform ND→NZ conversions concurrently.

Co-authored-by: hipudding <huafengchun@gmail.com>

* refactor

Signed-off-by: noemotiovon <757486878@qq.com>

* rename

Signed-off-by: noemotiovon <757486878@qq.com>

* fix review comments

Signed-off-by: noemotiovon <757486878@qq.com>

---------

Signed-off-by: noemotiovon <757486878@qq.com>
Co-authored-by: hipudding <huafengchun@gmail.com>
2025-09-20 13:42:49 +03:00
..
CMakeLists.txt CANN: add support for ACL Graph (llama/15065) 2025-08-18 20:30:45 +03:00
Doxyfile CANN: Add the basic supports of Flash Attention kernel (llama/13627) 2025-05-27 18:03:00 +03:00
acl_tensor.cpp CANN: Implement GLU ops (llama/14884) 2025-07-28 13:02:32 +03:00
acl_tensor.h CANN: Add the basic supports of Flash Attention kernel (llama/13627) 2025-05-27 18:03:00 +03:00
aclnn_ops.cpp ggml: add ops for WAN video model (cuda && cpu) (llama/15669) 2025-09-20 13:42:49 +03:00
aclnn_ops.h CANN: Add ggml_set_rows (llama/14943) 2025-08-18 20:30:45 +03:00
common.h CANN: Fix precision issue on 310I DUO multi-devices (llama/15784) 2025-09-20 13:42:49 +03:00
ggml-cann.cpp CANN: Refactor ND to NZ workspace to be per-device (llama/15763) 2025-09-20 13:42:49 +03:00