Skip to content

Commit bbfce1c

Browse files
zhaoyingliazhaoyinglia
committed
fix(plugin): complete public QKV format enum
1 parent b97a034 commit bbfce1c

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

  • transformer_engine/plugin/core

‎transformer_engine/plugin/core/ops.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -129,6 +129,8 @@ class NVTE_QKV_Format(IntEnum):
129129
NVTE_SBHD_2BSHD = 4
130130
NVTE_THD_2BSHD = 5
131131
NVTE_THD_2SBHD = 6
132+
NVTE_BHSD = 7
133+
NVTE_QKV_Format_NOT_SET = 8
132134

133135

134136
class NVTE_QKV_Layout(IntEnum):

0 commit comments

Comments
 (0)