Commits

History for

Commits on Jun 14, 2023

CUDA full GPU acceleration, KV cache in VRAM (ggerganov#1827 )
JohannesGaessler
authored

Commits on Jun 12, 2023

Leverage mmap for offloading tensors to GPU (ggerganov#1597 )

howard0su
and
JohannesGaessler
authored

Commits on Jun 6, 2023

Multi GPU support, CUDA refactor, CUDA scratch buffer (ggerganov#1703 )
JohannesGaessler
authored

Commits on May 20, 2023

cuda : loading models directly into VRAM, norm calculation on GPU, broadcasting for ggml_mul (ggerganov#1483 )

authored

Commits on May 13, 2023

ggml : GPU-accelerated token generation (ggerganov#1412 )

JohannesGaessler
and
ggerganov
authored

Commits on May 1, 2023

cuBLAS: refactor and optimize f16 mat mul performance (ggerganov#1259 )
slaren
authored

Commits on Apr 29, 2023

cuBLAS: use host pinned memory and dequantize while copying (ggerganov#1207 )
slaren
authored

Commits on Apr 28, 2023

Commits on Apr 26, 2023

ggml : add Q5_0 and Q5_1 quantization (ggerganov#1187 )

ggerganov
and
sw
authored

Commits on Apr 25, 2023

ggml : add Q8_0 quantization format (rename the old one to Q8_1) (ARM NEON) (ggerganov#1179 )
ggerganov
authored

Commits on Apr 21, 2023

Improve cuBLAS performance by using a memory pool (ggerganov#1094 )
slaren
authored

Commits on Apr 20, 2023

Loading