Bias semi structured sparse by afeldman-nm · Pull Request #24 · neuralmagic/nm-vllm · GitHub

This repository was archived by the owner on Oct 11, 2024. It is now read-only.

afeldman-nm commented Feb 16, 2024

SUMMARY:

2:4 semi-structured sparsity handles non-None bias

TEST:

examples/offline_inference_semi_structured_sparse.py
nm-testing/opt-125m-pruned2.4

afeldman-nm added 2 commits

February 16, 2024 14:06


          wip 2:4 bias fix

537a7a0


          2:4 bias support

a39de2f

afeldman-nm requested review from mgoin and robertgshaw2-redhat

February 16, 2024 20:26

mgoin closed this

Member

mgoin commented Feb 16, 2024 •

edited

Loading

Superseded by #25

afeldman-nm deleted the bias_semi_structured_sparse branch

August 7, 2024 04:47

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet