public_git/whisper.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/whisper.cpp.git synced 2026-10-22 03:48:19 +02:00
Code Issues Packages Projects Releases Wiki Activity

llama: refer to segment documentation [no ci] (llama/29074)

Browse Source
This commit is contained in:
Johannes Gäßler
2026-10-06 10:38:15 +03:00
committed by Georgi Gerganov
parent 15229ac95d
commit 3a3598cc24
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
ggml/include/ggml-backend.h
+1
View File
@@ -383,6 +383,7 @@ extern "C" {
// - most tensors have n_segments == 1 and a contiguous slice of the tensor data // - most tensors have n_segments == 1 and a contiguous slice of the tensor data
// - some tensors have an inhomogenenous data layout along the split axis, // - some tensors have an inhomogenenous data layout along the split axis,
// those tensors are divided into segments which are each individually split across devices // those tensors are divided into segments which are each individually split across devices
// (this usually happens when multiple tensors are fused into a single one)
// - ne has one entry per segment and device and that segment repeats nr times, // - ne has one entry per segment and device and that segment repeats nr times,
// in total when accounting for repetitions the segments add up to ggml_tensor::ne for that axis, // in total when accounting for repetitions the segments add up to ggml_tensor::ne for that axis,
// the outer/inner loops are over segments/devices like [seg0_dev0_r0, seg0_dev1_r0, seg0_dev0_r1, seg0_dev1_r1, seg1_dev0_r0, seg1_dev1_r0], // the outer/inner loops are over segments/devices like [seg0_dev0_r0, seg0_dev1_r0, seg0_dev0_r1, seg0_dev1_r1, seg1_dev0_r0, seg1_dev1_r0],