Skip to content

Adding support for fused moe kernels in sampler.#1385

Draft
NicoGrande wants to merge 1 commit intomainfrom
nicogrande/support-fused-moe
Draft

Adding support for fused moe kernels in sampler.#1385
NicoGrande wants to merge 1 commit intomainfrom
nicogrande/support-fused-moe

Conversation

@NicoGrande
Copy link
Copy Markdown
Collaborator

Resolves #<issue_number_goes_here>

It's a good idea to open an issue first for discussion.

Reference

Colab Notebook

Checklist

  • I have added all the necessary unit tests for my change.
  • I have verified that my change does not break existing code and all unit tests pass.
  • I have added all appropriate doc-strings/documentation.
  • My PR is based on the latest changes of the main branch (if unsure, rebase the code).
  • I have signed the Contributor License Agreement.
  • I have followed Contribution Guidelines.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants