Closed
Description
🐞 Describe the Bug
The base image update in #295 broke dropless MOE. test_mixtral_match_meg
and test_dropless_mlp
both fail with high diff and/or illegal memory access.
The base image update in #295 broke dropless MOE. test_mixtral_match_meg
and test_dropless_mlp
both fail with high diff and/or illegal memory access.