Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hotfix(MInference): fix the import warnings, fix the apply_rotary_pos… #30

Merged
merged 1 commit into from
Jul 12, 2024

Conversation

iofu728
Copy link
Contributor

@iofu728 iofu728 commented Jul 12, 2024

What does this PR do?

Feature

Bug fixed

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Was this discussed/approved via a Github issue? Please add a link
    to it if that's the case.
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

Who can review?

@iofu728

…_emb_single, fix phi-3 vs kernel

Feature(MInference): remove pycuda, support multi-gpu
@iofu728 iofu728 self-assigned this Jul 12, 2024
@iofu728 iofu728 added bug Something isn't working documentation Improvements or additions to documentation feature feature labels Jul 12, 2024
@iofu728 iofu728 merged commit d2d8747 into main Jul 12, 2024
1 check passed
@iofu728 iofu728 deleted the hjiang/fix_apply_rotary_pos_emb_single branch July 12, 2024 07:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working documentation Improvements or additions to documentation feature feature
Projects
None yet
1 participant