Skip to content

Commit 833e603

Browse files
Update examples/attention_sink/example_mha_sink_fwd_bhsd_wgmma_pipelined.py
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
1 parent 70ddf77 commit 833e603

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/attention_sink/example_mha_sink_fwd_bhsd_wgmma_pipelined.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -143,7 +143,7 @@ def main(
143143
scores_scale = T.alloc_fragment([block_M], accum_dtype)
144144
scores_sum = T.alloc_fragment([block_M], accum_dtype)
145145
logsum = T.alloc_fragment([block_M], accum_dtype)
146-
sinks = T.alloc_fragment([heads], dtype)
146+
sinks = T.alloc_fragment([block_M], dtype)
147147

148148
T.copy(Q[bz, by, bx * block_M:(bx + 1) * block_M, :], Q_shared)
149149
T.fill(acc_o, 0)

0 commit comments

Comments
 (0)