2 Commits

Author	SHA1	Message	Date
Georgi Gerganov	503a786c9a	bench : update numbers [no ci] (#2993)	2025-04-02 16:27:36 +03:00
Georgi Gerganov	7094ea5e75	whisper : use flash attention (#2152) ... * whisper : use flash attention in the encoder * whisper : add kv_pad * whisper : remove extra backend instance (huh?) * whisper : use FA for cross-attention * whisper : use FA for self-attention * whisper : simplify encoder FA * whisper : add flash_attn runtime parameter * scripts : add bench log * scripts : add M1 Pro bench log	2024-05-15 09:38:19 +03:00