Matthew Michel 0a5b4c2e9b sycl: use async memory allocation to fix crashes during graph recording (llama/16644) ...

* sycl: use async memory allocation to fix graph recording failures

GGML_SYCL_DISABLE_GRAPHS=0 causes crashes because:
  - Host waits are currently unsupported in graph recording mode.
  - SYCL malloc / free calls are unsupported in graph recording mode.

The following changes are made to fix SYCL graph functionality:
  - When graphs are enabled, use the SYCL async memory extension for temp
    buffers which is supported with SYCL graphs.
  - For compiler versions that do not support this extension, skip
    graphs with the affected op.
  - Switch from USM shared to device memory as the async extension
    currently just supports device allocations.

* Address reviewer feedback

* Use global async variable to decide path in sycl_ext_[malloc_device|free]

2025-11-09 23:38:03 +02:00

..

cmake

ggml: Skip backend library linking code when GGML_BACKEND_DL=ON (llama/15094)

2025-08-18 20:30:45 +03:00

include

Add experimental ggml-hexagon backend for the Hexagon NPU (llama/16547)

2025-11-09 23:38:03 +02:00

src

sycl: use async memory allocation to fix crashes during graph recording (llama/16644)

2025-11-09 23:38:03 +02:00

.gitignore

…

CMakeLists.txt

Add experimental ggml-hexagon backend for the Hexagon NPU (llama/16547)

2025-11-09 23:38:03 +02:00