21da84303e
* Optimize Metal Tensor API usage for matmul2d Separates the Metal Tensor API (matmul2d) path in kernel_mul_mm into its own standalone kernel, gated by GGML_METAL_HAS_TENSOR. The legacy simdgroup_matrix kernel is preserved under #else. Previously both paths were interleaved via #ifdef blocks within a single kernel, forcing the tensor path to share the legacy kernel's data layout and threadgroup memory scheme. Splitting the kernel enabled memory and dispatch optimizations that weren't possible when the two paths shared code structure. * cont : cleanup * cont : cleanup * cont : cleanup --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> |
||
|---|---|---|
| .. | ||
| CMakeLists.txt | ||
| ggml-metal-common.cpp | ||
| ggml-metal-common.h | ||
| ggml-metal-context.h | ||
| ggml-metal-context.m | ||
| ggml-metal-device.cpp | ||
| ggml-metal-device.h | ||
| ggml-metal-device.m | ||
| ggml-metal-impl.h | ||
| ggml-metal-ops.cpp | ||
| ggml-metal-ops.h | ||
| ggml-metal.cpp | ||
| ggml-metal.metal | ||