Skip to content

shivpalSW/Optimized-CPU-Implementation-of-Llama2

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Optimized-CPU-Implementation-of-Llama2

Optimized CPU Implementation of Llama2

Implimented :-

"TheBloke/Llama-2-7B-Chat-GGML" 4-bit Model from Huggingface Hub Model Link

Simple UI on local

alt text