Skip to content

Commit

Permalink
ggml : add Q4_0_8_8 RISC-V GEMV and GEMM kernels (llama/10029)
Browse files Browse the repository at this point in the history
* ggml : RISC-V vector gemv for q4_0_8x8

* ggml : Added WIP rvv q4_0_8x8 gemm

* ggml : Added initial implementation of rvv gemm

* ggml : optimize gemm to avoid register spillover

* ggml : Fix GCC rvv load alignment issue

* ggml : Format gemm rvv code

* ggml : Fix a typo in RVV q4_0_8_8 GEMM
  • Loading branch information
xctan authored and ggerganov committed Nov 4, 2024
1 parent da649f7 commit 6b74693
Showing 1 changed file with 268 additions and 0 deletions.
Loading

0 comments on commit 6b74693

Please sign in to comment.