Replies: 1 comment
-
Hi thanks for your result! How do I read these values? Is the t/s generated tokens or evaluated? Thanks 😀 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
bugra@llamafile:~$ ./llamafile-bench-0.8.6 -p "256,512,1024" -m qwen2-7b-instruct-fp16.gguf,qwen2-7b-instruct-q5_k_m.gguf
Beta Was this translation helpful? Give feedback.
All reactions