This repository was archived by the owner on Jun 24, 2024. It is now read-only.
This repository was archived by the owner on Jun 24, 2024. It is now read-only.
perf: add benchmarks #132
Open
Description
#4 mentions doing benchmarking. We should add some microbenchmarks to show the words per second v.s. llama.cpp. In fact, we should use a similar benchmarking methodology to llama.cpp to get an apples to apples comparison.