We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 7f592ab commit 2abb1fdCopy full SHA for 2abb1fd
1 file changed
candle-nn/src/cpu_flash_attention.rs
@@ -68,7 +68,7 @@ fn vec_dot<T: WithDType + Sum + Copy + std::ops::Mul<Output = T>>(a: &[T], b: &[
68
/// - `k`: (bs, kv_seq, v_head, hidden)
69
/// - `k`: (bs, kv_seq, kv_head_seq, v_hidden)
70
/// - `scale` is applied before softmax.
71
-///
+///
72
/// - This supports ALiBi with `max_bias` as well as softcapping with `softcap`.
73
///
74
/// **Output shape:** (bs, seq, qhead, v_hidden)
0 commit comments