Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Kernel] [Triton] Memory optimization for awq_gemm and awq_dequantize, 2x throughput #8248

Merged
merged 2 commits into from
Sep 6, 2024
Merged

[Kernel] [Triton] Memory optimization for awq_gemm and awq_dequantize, 2x throughput #8248

merged 2 commits into from
Sep 6, 2024

Commits on Sep 6, 2024

  1. Add optimization to reduce number of loads

    @rasmith
    rasmith committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    fc54694 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'vllm-project:main' into ransmith_awq_opt

    @rasmith
    rasmith authored Sep 6, 2024
    Configuration menu
    Copy the full SHA
    1bd914b View commit details
    Browse the repository at this point in the history