Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Replit + MPT #145

Merged
merged 26 commits into from
May 17, 2023
Merged

Replit + MPT #145

merged 26 commits into from
May 17, 2023

Commits on May 9, 2023

  1. Add replit model

    @lukasmoellerch
    lukasmoellerch committed May 9, 2023
    Configuration menu
    Copy the full SHA
    418d844 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Add unigram tokenization support

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    c08ab88 View commit details
    Browse the repository at this point in the history

  2. Remove debug log

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    77e6c87 View commit details
    Browse the repository at this point in the history

  3. Port alibi attn bias fix

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    c880ab6 View commit details
    Browse the repository at this point in the history

  4. Remove torch input

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    1eb5cda View commit details
    Browse the repository at this point in the history

  5. Fix hardcoded path

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    0ea3532 View commit details
    Browse the repository at this point in the history

  6. Remove unsupported hyperparams

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    9bea19d View commit details
    Browse the repository at this point in the history

  7. Add mpt

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    bf237cb View commit details
    Browse the repository at this point in the history

  8. Add replit quantization script

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    353873d View commit details
    Browse the repository at this point in the history

  9. Remove debug print

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    ab0bc67 View commit details
    Browse the repository at this point in the history

  10. Add quantization support to mpt

    @lukasmoellerch
    lukasmoellerch committed May 10, 2023
    Configuration menu
    Copy the full SHA
    b43281a View commit details
    Browse the repository at this point in the history

Commits on May 13, 2023

  1. Reformat

    @lukasmoellerch
    lukasmoellerch committed May 13, 2023
    Configuration menu
    Copy the full SHA
    337630d View commit details
    Browse the repository at this point in the history

  2. Remove trailing return type

    @lukasmoellerch
    lukasmoellerch committed May 13, 2023
    Configuration menu
    Copy the full SHA
    45f59c6 View commit details
    Browse the repository at this point in the history

  3. Implement stylistic changes

    @lukasmoellerch
    lukasmoellerch committed May 13, 2023
    Configuration menu
    Copy the full SHA
    0963049 View commit details
    Browse the repository at this point in the history

  4. use f16 in k/v memory calculations for replit/mpt

    @lukasmoellerch
    lukasmoellerch committed May 13, 2023
    Configuration menu
    Copy the full SHA
    011d2b1 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2023

  1. Update context size calculation

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    478fde7 View commit details
    Browse the repository at this point in the history

  2. Add clip_qkv and alibi_bias_max support

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    0f64ed9 View commit details
    Browse the repository at this point in the history

  3. fix clamping implementation, remove implicit conversions

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    3e7e3e0 View commit details
    Browse the repository at this point in the history

  4. Fix qkv if condition

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    bf2cc21 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into replit

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    0acd380 View commit details
    Browse the repository at this point in the history

  6. Fix replit context size calculation

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    ff8de0e View commit details
    Browse the repository at this point in the history

  7. Potentially fix gcc compilation error

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    26c9e91 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into replit

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    018d973 View commit details
    Browse the repository at this point in the history

  9. Fix warning

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    43c3245 View commit details
    Browse the repository at this point in the history

  10. Adjust object overhead

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    409da4f View commit details
    Browse the repository at this point in the history

  11. Remove dead code

    @lukasmoellerch
    lukasmoellerch committed May 14, 2023
    Configuration menu
    Copy the full SHA
    d404de8 View commit details
    Browse the repository at this point in the history