Skip to content

Commit

Permalink
k-quants : fix zero-weight guard in Q6_K (ref #3040)
Browse files Browse the repository at this point in the history
  • Loading branch information
ggerganov committed Sep 6, 2023
1 parent ea2c85d commit 178b185
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions k_quants.c
Original file line number Diff line number Diff line change
Expand Up @@ -1089,6 +1089,7 @@ void quantize_row_q6_K_reference(const float * restrict x, block_q6_K * restrict
if (!max_abs_scale) {
memset(&y[i], 0, sizeof(block_q6_K));
y[i].d = ggml_fp32_to_fp16(0.f);
x += QK_K;
continue;
}

Expand Down

0 comments on commit 178b185

Please sign in to comment.