Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Adept Persimmon 8b #3410

Merged
merged 30 commits into from
Oct 7, 2023
Merged

Support Adept Persimmon 8b #3410

merged 30 commits into from
Oct 7, 2023

Commits on Sep 21, 2023

  1. Produces garbage output

    @phillip-kravtsov
    phillip-kravtsov committed Sep 21, 2023
    Configuration menu
    Copy the full SHA
    7cdc3ea View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2023

  1. wip: correct tensors up to RoPE

    @phillip-kravtsov
    phillip-kravtsov committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    4bcf412 View commit details
    Browse the repository at this point in the history

  2. correct tensors thru RoPE

    @phillip-kravtsov
    phillip-kravtsov committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    c9e1446 View commit details
    Browse the repository at this point in the history

  3. Correct outputs through masked & softmax'd KQ

    @phillip-kravtsov
    phillip-kravtsov committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    d1b40ef View commit details
    Browse the repository at this point in the history

  4. fp32 works

    @phillip-kravtsov
    phillip-kravtsov committed Sep 26, 2023
    Configuration menu
    Copy the full SHA
    db2181a View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Rename adept->persimmon

    @phillip-kravtsov
    phillip-kravtsov committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    3f31799 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:phillip-kravtsov/llama.cpp into p… 

    …hillip-kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    720503b View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Produces correct outputs

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d61eed0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d0a7143 View commit details
    Browse the repository at this point in the history

  3. clean up convert scripts

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    fa92f6e View commit details
    Browse the repository at this point in the history

  4. remove printing logic from ggml.c

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    c28a6c5 View commit details
    Browse the repository at this point in the history

  5. remove prints from llama.cpp & fix merge

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    47dcb9f View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    7473773 View commit details
    Browse the repository at this point in the history

  7. trivial cleanups

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d904aff View commit details
    Browse the repository at this point in the history

  8. Add offload funcs

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    ec0ce97 View commit details
    Browse the repository at this point in the history

  9. update conversion script to directly take adept artifacts rather than… 

    … .saftensors file
    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    3db04db View commit details
    Browse the repository at this point in the history

  10. Fix norm eps bug

    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    f28f52c View commit details
    Browse the repository at this point in the history

  11. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    d93cf1e View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2023

  1. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    574a9e1 View commit details
    Browse the repository at this point in the history

  2. Support sqr and concat on metal, persimmon-8b-q4 runs correctly

    @phillip-kravtsov
    phillip-kravtsov committed Sep 30, 2023
    Configuration menu
    Copy the full SHA
    2b56591 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2023

  1. Small changes from review

    @phillip-kravtsov
    phillip-kravtsov committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    e6bf87f View commit details
    Browse the repository at this point in the history

  2. Formatting changes

    @phillip-kravtsov
    phillip-kravtsov committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    cd4d3df View commit details
    Browse the repository at this point in the history

  3. Minor changes to conversion script

    @phillip-kravtsov
    phillip-kravtsov committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    422b110 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    5a0990c View commit details
    Browse the repository at this point in the history

  5. Remove old script

    @phillip-kravtsov
    phillip-kravtsov committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    7a279fe View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2023

  1. Fix editorconfig formatting

    @phillip-kravtsov
    phillip-kravtsov committed Oct 3, 2023
    Configuration menu
    Copy the full SHA
    c90ed9f View commit details
    Browse the repository at this point in the history

Commits on Oct 5, 2023

  1. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b. ggml-ci
    @phillip-kravtsov
    phillip-kravtsov committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    5d259d3 View commit details
    Browse the repository at this point in the history

  2. Fix build

    @phillip-kravtsov
    phillip-kravtsov committed Oct 5, 2023
    Configuration menu
    Copy the full SHA
    1d518d6 View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Merge branch 'master' of github.com:ggerganov/llama.cpp into phillip-… 

    …kravtsov/support-adept-persimmon-8b
    @phillip-kravtsov
    phillip-kravtsov committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    0c1a8f6 View commit details
    Browse the repository at this point in the history

  2. add overlooked offload code ggml-ci

    @phillip-kravtsov
    phillip-kravtsov committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    485a471 View commit details
    Browse the repository at this point in the history