Skip to content

Commit

Permalink
opencl : support k-quants (ggerganov#1836)
Browse files Browse the repository at this point in the history
* Porting q2_k kernel to OpenCL

* Set global and local sizes for kernel calls for dequantizing k-quants

* Added q6_k kernel

* Fix q4_k opencl struct order

* Replace uchar with uint8_t

* Finish dequant kernels

* Added OpenCL DMMV kernels

* Fix q2_k, improve code

* Fix q3_k

* Shorten switch statements

* Improve code formatting

---------

Co-authored-by: Concedo <39025047+LostRuins@users.noreply.github.com>
  • Loading branch information
0cc4m and LostRuins authored Jun 16, 2023
1 parent b41b4ca commit d411968
Showing 1 changed file with 489 additions and 4 deletions.
Loading

0 comments on commit d411968

Please sign in to comment.