Add 4-bit quantized inference to run BLOOM-176B on 2 A100 GPUs#2526
Open
RezaYazdaniAminabadi wants to merge 14 commits intomasterfrom quantize-inference
+363-146
Commits
Commits on Nov 17, 2022
- committed
Reza Yazdani Aminabadi - committedReza Yazdani
- committedReza Yazdani Aminabadi
Commits on Nov 18, 2022
- committedReza Yazdani
- committedReza Yazdani Aminabadi
- authored
- committedReza Yazdani
- committedReza Yazdani
Commits on Nov 19, 2022
- committedReza Yazdani Aminabadi
- committedReza Yazdani Aminabadi
- authored
Commits on Nov 21, 2022
- committed
- committed
Commits on Dec 14, 2022
- committedReza Yazdani