Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature(MInference): support LLaMA-3-70B-1M and multi-gpu PP #59

Merged
merged 1 commit into from
Aug 1, 2024

Conversation

iofu728
Copy link
Contributor

@iofu728 iofu728 commented Aug 1, 2024

What does this PR do?

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Was this discussed/approved via a Github issue?
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

Who can review?

@iofu728

@iofu728 iofu728 added documentation Improvements or additions to documentation feature feature labels Aug 1, 2024
@iofu728 iofu728 self-assigned this Aug 1, 2024
@iofu728 iofu728 merged commit 7a11a33 into main Aug 1, 2024
1 check passed
@iofu728 iofu728 deleted the hjiang/support_llama_3_70B branch August 1, 2024 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation feature feature
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant