Skip to content

显存占满之前就开始使用共享显存 #405

New issue
New issue
Open
Open
显存占满之前就开始使用共享显存#405
@0pera

Description

@0pera
0pera
opened on Dec 2, 2024

我尝试用我的老笔记本（GTX 1050Ti 4G显存）跑着玩一下，但是哪怕加载最小的模型，输出速度依然很慢。我打开任务管理器检查，发现显存占用比例比较奇怪，有比较多的共享显存占用：
屏幕截图 2024-12-02 091956

我尝试过用Jan来跑小模型，在显存没爆的情况下，应该不至于只有2token/s……

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions