Skip to content

[Misc]: Isolate CPUModelRunner and ModelRunner for better maintenance #3776

New issue
New issue
Closed
#3824
Closed
[Misc]: Isolate CPUModelRunner and ModelRunner for better maintenance#3776
#3824
Labels
misc
@bigPYJ1151

Description

@bigPYJ1151
bigPYJ1151
opened on Apr 1, 2024

Anything you want to discuss about vllm.

This is a ticket to track the remaining work about #3634 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    misc

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions