Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Impl simple mamba model #1480

Merged
merged 22 commits into from
Feb 8, 2024
Merged

Impl simple mamba model #1480

merged 22 commits into from
Feb 8, 2024

Commits on Jan 23, 2024

  1. feat: initial weight load

    @drbh
    drbh committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    bcf1457 View commit details
    Browse the repository at this point in the history

Commits on Jan 25, 2024

  1. feat: mvp single inference and explore integration

    @drbh
    drbh committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    35939a2 View commit details
    Browse the repository at this point in the history

  2. feat: prefer custom model and produce correct output

    @drbh
    drbh committed Jan 25, 2024
    Configuration menu
    Copy the full SHA
    1c32d53 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. feat: build custom selective-scan kernels

    @drbh
    drbh committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    c2681b2 View commit details
    Browse the repository at this point in the history

  2. feat: use fused kernel in forward pass

    @drbh
    drbh committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    966f3ba View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. feat: add optimization and first pass of integration test

    @drbh
    drbh committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    5b6f925 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. fix: start to add caching of previous states

    @drbh
    drbh committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    2d67462 View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2024

  1. feat: use cache when decoding

    @drbh
    drbh committed Feb 2, 2024
    Configuration menu
    Copy the full SHA
    3a42765 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. fix: revise non batching tests

    @drbh
    drbh committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    0f124cb View commit details
    Browse the repository at this point in the history

Commits on Feb 5, 2024

  1. feat: avoid triton selective_state_update

    @drbh
    drbh committed Feb 5, 2024
    Configuration menu
    Copy the full SHA
    a4f1916 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. fix: improve step to use batch

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    63bc4c5 View commit details
    Browse the repository at this point in the history

  2. feat: support batching

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    3caa9b9 View commit details
    Browse the repository at this point in the history

  3. Fix mamba load.

    @Narsil
    Narsil committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    8319e85 View commit details
    Browse the repository at this point in the history

  4. feat: prefer triton ops and batch conv

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    5e10218 View commit details
    Browse the repository at this point in the history

  5. fix: rename tests and snapshots

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    36a4853 View commit details
    Browse the repository at this point in the history

  6. feat: update docker for mamba

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    50ca04b View commit details
    Browse the repository at this point in the history

  7. fix: update selective state Makefile

    @drbh
    drbh committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    5b30a42 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'main' into impl-simple-mamba-model

    @drbh
    drbh authored Feb 6, 2024
    Configuration menu
    Copy the full SHA
    9146ba0 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. fix: adjust typos and docker build

    @drbh
    drbh committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    deed8e8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'impl-simple-mamba-model' of github.com:huggingface/text… 

    …-generation-inference into impl-simple-mamba-model
    @drbh
    drbh committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    48624fe View commit details
    Browse the repository at this point in the history

  3. fix: add missing accepted_ids to batch_top_tokens

    @drbh
    drbh committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    2c6ef7c View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. feat: conditionally include mamba

    @drbh
    drbh committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    b99f784 View commit details
    Browse the repository at this point in the history