Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LoRA] Add support for pinning lora adapters in the LRU cache #5603

Merged
merged 7 commits into from
Jun 21, 2024
Merged

[LoRA] Add support for pinning lora adapters in the LRU cache #5603

merged 7 commits into from
Jun 21, 2024

Commits on Jun 17, 2024

  1. support pinning adapters

    @rohithkrn
    rohithkrn committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    838f602 View commit details
    Browse the repository at this point in the history

  2. fix lint

    @rohithkrn
    rohithkrn committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    2d06da1 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. format code

    @rohithkrn
    rohithkrn committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    9495bf0 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. modify remove_oldest to use sentinel for all pinned items and address… 

    … comments
    @rohithkrn
    rohithkrn committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    5873777 View commit details
    Browse the repository at this point in the history

  2. fix lint

    @rohithkrn
    rohithkrn committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    4721bd9 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. format

    @rohithkrn
    rohithkrn committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    045eb9c View commit details
    Browse the repository at this point in the history

  2. move pin lora to LRUCache model manager

    @rohithkrn
    rohithkrn committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    9e1d1eb View commit details
    Browse the repository at this point in the history