Skip to content

Commit da3cb54

Browse files
committed
Add TODO
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
1 parent fe89c0b commit da3cb54

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

tests/compile/test_fusion.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,8 @@ def forward(self, x):
6464
input_scale=self.scale[0])
6565
# make sure resid is used for replacement to work
6666
y2, resid = self.norm[1](x2, resid)
67-
67+
# TODO another fp8 linear + rmsnorm to make sure fusion
68+
# works for residual output as well
6869
x3 = self.fp8_linear.apply(y2,
6970
self.w[1],
7071
self.wscale[1],

0 commit comments

Comments
 (0)