Skip to content

[bug] MOE is broken with triton 3.2.0, 3.3.0 and 3.3.1 #303

Closed
@jlamypoirier

Description

@jlamypoirier

🐞 Describe the Bug

The base image update in #295 broke dropless MOE. test_mixtral_match_meg and test_dropless_mlp both fail with high diff and/or illegal memory access.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions