R0CKSTAR
7c077845fd
musa: add GGML_UNUSED_VARS (llama/15446)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-09-20 13:42:38 +03:00
R0CKSTAR
0eb2d653bd
musa: fix build warnings (llama/15258)
...
* musa: fix build warnings
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* fix warning: comparison of integers of different signs: 'const int' and 'unsigned int' [-Wsign-compare]
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-09-20 13:42:38 +03:00
R0CKSTAR
02b49af98d
musa: handle __hgt2_mask, available starting from MUSA SDK rc4.3.0 (llama/15413)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-09-20 13:42:37 +03:00
R0CKSTAR
8e2ddfec31
musa: fix failures in test-backend-ops for mul_mat_id op (llama/15236)
...
* musa: fix failures in test-backend-ops for mul_mat_id op
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-08-18 20:30:45 +03:00
R0CKSTAR
8643960acc
musa: fix build warnings (unused variable) (llama/14869)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-07-28 13:02:32 +03:00
R0CKSTAR
89ae789450
musa: upgrade musa sdk to rc4.2.0 (llama/14498)
...
* musa: apply mublas API changes
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: update musa version to 4.2.0
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: restore MUSA graph settings in CMakeLists.txt
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: disable mudnnMemcpyAsync by default
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: switch back to non-mudnn images
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* minor changes
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: restore rc in docker image tag
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-07-28 13:02:32 +03:00
R0CKSTAR
9008410087
cuda: remove linking to cublasLt (llama/14790)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-07-28 13:02:32 +03:00
R0CKSTAR
ab79c6c118
cuda: fix build warnings in set-rows.cu (unused variable) (llama/14687)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-07-20 00:23:50 +03:00
R0CKSTAR
7e9c6bbab2
musa: fix build warnings (unused variable) (llama/14561)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-07-12 19:23:56 +03:00
R0CKSTAR and Johannes Gäßler
a5e6a3c953
musa: enable fp16 mma (all) and cublas on qy2 (llama/13842)
...
* musa: enable fp16 mma (all) and cublas on qy2
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Update ggml/src/ggml-cuda/ggml-cuda.cu
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Address review comments
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: disable MUL_MAT_ID (q2_k × f32) due to precision issues
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2025-07-01 17:54:53 +03:00
R0CKSTAR
2a84593960
musa: fix build warning (unused variable) (llama/14231)
...
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2025-06-18 12:40:34 +03:00
R0CKSTAR and Johannes Gäßler
131ee546ca
musa: Upgrade MUSA SDK version to rc4.0.1 and use mudnn::Unary::IDENTITY op to accelerate D2D memory copy (llama/13647)
...
* musa: fix build warning (unused parameter)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: upgrade MUSA SDK version to rc4.0.1
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* musa: use mudnn::Unary::IDENTITY op to accelerate D2D memory copy
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Update ggml/src/ggml-cuda/cpy.cu
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
* musa: remove MUDNN_CHECK_GEN and use CUDA_CHECK_GEN instead in MUDNN_CHECK
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
Co-authored-by: Johannes Gäßler <johannesg@5d6.de >
2025-05-27 18:03:00 +03:00
R0CKSTAR
e471adcfa5
feat: Support Moore Threads GPU (llama/8383)
...
* Update doc for MUSA
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Add GGML_MUSA in Makefile
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Add GGML_MUSA in CMake
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* CUDA => MUSA
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* MUSA adds support for __vsubss4
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
* Fix CI build failure
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
---------
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com >
2024-08-08 22:48:46 +03:00
R0CKSTAR