Skip to content

Commit 78eea65

Browse files
comanedakinggg
andauthored
set default value of mlp_impl to grouped in layers/arguments (#171)
Co-authored-by: Daniel King <43149077+dakinggg@users.noreply.github.com>
1 parent 501af34 commit 78eea65

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

megablocks/layers/arguments.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ class Arguments:
4747
# Compute arguments.
4848
memory_optimized_mlp: bool = False
4949
mlp_type: str = 'mlp'
50-
mlp_impl: str = 'sparse'
50+
mlp_impl: str = 'grouped'
5151

5252
# Initialization arguments.
5353
fp16: bool = True

0 commit comments

Comments
 (0)