Skip to content

Commit 26c2750

Browse files
committed
musa: support flash attention (#9)
Signed-off-by: Xiaodong Ye <[email protected]>
1 parent a788177 commit 26c2750

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

discover/types.go

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -184,7 +184,8 @@ func (l GpuInfoList) FlashAttentionSupported() bool {
184184
supportsFA := gpu.Library == "cpu" ||
185185
gpu.Library == "metal" ||
186186
(gpu.Library == "cuda" && gpu.DriverMajor >= 7) ||
187-
gpu.Library == "rocm"
187+
gpu.Library == "rocm" ||
188+
gpu.Library == "musa"
188189

189190
if !supportsFA {
190191
return false

0 commit comments

Comments
 (0)