Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[INFER][LLM] Support qwen in fined grained dybatch v1 #7644

Merged
merged 23 commits into from
Jan 9, 2024
Merged

[INFER][LLM] Support qwen in fined grained dybatch v1 #7644

merged 23 commits into from
Jan 9, 2024

Commits on Dec 20, 2023

  1. init qwen inference model

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    a9d7c0f View commit details
    Browse the repository at this point in the history

  2. fix name

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    3258b63 View commit details
    Browse the repository at this point in the history

  3. fix hidden dim

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    b8d715f View commit details
    Browse the repository at this point in the history

  4. fix dtype

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    7448c07 View commit details
    Browse the repository at this point in the history

  5. fix length

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    2aeb294 View commit details
    Browse the repository at this point in the history

  6. fix attention_mask

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    9de1e79 View commit details
    Browse the repository at this point in the history

  7. fix up & gate dtype bug

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    c6a9aa6 View commit details
    Browse the repository at this point in the history

  8. fix ffn1 weight

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    69e9b04 View commit details
    Browse the repository at this point in the history

  9. modify codes

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    568954e View commit details
    Browse the repository at this point in the history

  10. remote unused variable

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    1e826ad View commit details
    Browse the repository at this point in the history

  11. remove unused code

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    c2d9653 View commit details
    Browse the repository at this point in the history

  12. add qwen weight only

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    a9d0149 View commit details
    Browse the repository at this point in the history

  13. format with black

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    2d184ba View commit details
    Browse the repository at this point in the history

  14. format with isort

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    cb45b36 View commit details
    Browse the repository at this point in the history

  15. fix dtype

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    17793d0 View commit details
    Browse the repository at this point in the history

  16. add qwen inference model in static graph

    @DanGuge
    DanGuge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    87caabd View commit details
    Browse the repository at this point in the history

Commits on Dec 26, 2023

  1. add qwen unittest

    @DanGuge
    DanGuge committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    a6e36d3 View commit details
    Browse the repository at this point in the history

  2. format with black

    @DanGuge
    DanGuge committed Dec 26, 2023
    Configuration menu
    Copy the full SHA
    622b6b0 View commit details
    Browse the repository at this point in the history

Commits on Dec 29, 2023

  1. print log

    @DanGuge
    DanGuge committed Dec 29, 2023
    Configuration menu
    Copy the full SHA
    f234141 View commit details
    Browse the repository at this point in the history

Commits on Jan 3, 2024

  1. remove print

    @DanGuge
    DanGuge committed Jan 3, 2024
    Configuration menu
    Copy the full SHA
    724756b View commit details
    Browse the repository at this point in the history

Commits on Jan 6, 2024

  1. set safetensors usage False

    @DanGuge
    DanGuge committed Jan 6, 2024
    Configuration menu
    Copy the full SHA
    64731e4 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2024

  1. remove tests

    @DanGuge
    DanGuge committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    2429b08 View commit details
    Browse the repository at this point in the history

  2. Empty-Commit

    @DanGuge
    DanGuge committed Jan 8, 2024
    Configuration menu
    Copy the full SHA
    4d478e8 View commit details
    Browse the repository at this point in the history