Skip to content

Commit b104e0a

Browse files
authored
Add flash_attn_available flag for metax and iluvatar (#2256)
* add flash_attn_available flag for metax and iluvatar * remove metax flag
1 parent 80a8a50 commit b104e0a

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

backends/iluvatar_gpu/common/cuda_flags.cc

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -272,3 +272,8 @@ PHI_DEFINE_EXPORTED_bool(enable_ixattnbkd,
272272
false,
273273
"Whether enable ixattnbkd for flash attention or "
274274
"not, default is False.");
275+
276+
PHI_DEFINE_EXPORTED_bool(
277+
flash_attn_available,
278+
true,
279+
"Weather flash attention is available on the current device.");

0 commit comments

Comments
 (0)