Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tensor parallel MOE implementation #2293

Closed
wants to merge 50 commits into from
Closed

tensor parallel MOE implementation #2293

wants to merge 50 commits into from

Commits on Dec 27, 2023

  1. expert parallel moe

    @scv119
    scv119 committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    92c3a3c View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Dec 27, 2023
    Configuration menu
    Copy the full SHA
    d24d9dd View commit details
    Browse the repository at this point in the history

Commits on Dec 28, 2023

  1. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    408ed6d View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    ec913db View commit details
    Browse the repository at this point in the history

  3. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    56f3220 View commit details
    Browse the repository at this point in the history

  4. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    6067ec6 View commit details
    Browse the repository at this point in the history

  5. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    869e0c5 View commit details
    Browse the repository at this point in the history

  6. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    ea44a0f View commit details
    Browse the repository at this point in the history

  7. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    90e223a View commit details
    Browse the repository at this point in the history

  8. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    69b5a55 View commit details
    Browse the repository at this point in the history

  9. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    357b046 View commit details
    Browse the repository at this point in the history

  10. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    86f7e1e View commit details
    Browse the repository at this point in the history

  11. update

    @scv119
    scv119 committed Dec 28, 2023
    Configuration menu
    Copy the full SHA
    40f0f59 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2023

  1. update

    @scv119
    scv119 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    baa90d2 View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    4367d6a View commit details
    Browse the repository at this point in the history

  3. update

    @scv119
    scv119 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    b4df657 View commit details
    Browse the repository at this point in the history

  4. update

    @scv119
    scv119 committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    1ac4890 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2023

  1. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    14f29b3 View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    b3a1b77 View commit details
    Browse the repository at this point in the history

  3. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    8045832 View commit details
    Browse the repository at this point in the history

  4. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    5eb304a View commit details
    Browse the repository at this point in the history

  5. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    a172a7c View commit details
    Browse the repository at this point in the history

  6. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    a56b2df View commit details
    Browse the repository at this point in the history

  7. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    ca7110e View commit details
    Browse the repository at this point in the history

  8. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    82de999 View commit details
    Browse the repository at this point in the history

  9. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    20fcbc0 View commit details
    Browse the repository at this point in the history

  10. update

    @scv119
    scv119 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    92709c1 View commit details
    Browse the repository at this point in the history

Commits on Dec 31, 2023

  1. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    22daa9b View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    42c659d View commit details
    Browse the repository at this point in the history

  3. udpate

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    4e84e02 View commit details
    Browse the repository at this point in the history

  4. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    d586474 View commit details
    Browse the repository at this point in the history

  5. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    15f820f View commit details
    Browse the repository at this point in the history

  6. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    e0d9440 View commit details
    Browse the repository at this point in the history

  7. update

    @scv119
    scv119 committed Dec 31, 2023
    Configuration menu
    Copy the full SHA
    817e0bb View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. Apply suggestions from code review 

    Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
    @scv119 @WoosukKwon
    scv119 and WoosukKwon authored Jan 4, 2024
    Configuration menu
    Copy the full SHA
    285e7af View commit details
    Browse the repository at this point in the history

  2. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    d850834 View commit details
    Browse the repository at this point in the history

  3. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    920209f View commit details
    Browse the repository at this point in the history

  4. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    fdd5b77 View commit details
    Browse the repository at this point in the history

  5. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    17d17f1 View commit details
    Browse the repository at this point in the history

  6. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    6c60c3b View commit details
    Browse the repository at this point in the history

  7. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    9749e64 View commit details
    Browse the repository at this point in the history

  8. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    4bee472 View commit details
    Browse the repository at this point in the history

  9. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    0fe75f3 View commit details
    Browse the repository at this point in the history

  10. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    cce13fb View commit details
    Browse the repository at this point in the history

  11. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    f0f1d5e View commit details
    Browse the repository at this point in the history

  12. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    42b3cc3 View commit details
    Browse the repository at this point in the history

  13. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    0a8069b View commit details
    Browse the repository at this point in the history

  14. update

    @scv119
    scv119 committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    f955162 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. reorder operations

    @scv119
    scv119 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    1089dd8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into moe

    @scv119
    scv119 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    43ec685 View commit details
    Browse the repository at this point in the history