Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Prototype of vLLM execution on CPU-only devices #1028

Closed
wants to merge 3 commits into from
Closed

[Feature] Prototype of vLLM execution on CPU-only devices #1028

wants to merge 3 commits into from

Commits on Jan 31, 2024

  1. Prototype of CPU-only execution for vLLM. 

    Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
    @bigPYJ1151 @jikunshang
    bigPYJ1151 and jikunshang committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    e811c70 View commit details
    Browse the repository at this point in the history

  2. CPU only build (vllm-project#9)

    @maktukmak @bigPYJ1151
    maktukmak authored and bigPYJ1151 committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ad25d65 View commit details
    Browse the repository at this point in the history

  3. Remove internal files

    @bigPYJ1151
    bigPYJ1151 committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    e394e2b View commit details
    Browse the repository at this point in the history