Skip to content
This repository was archived by the owner on Jun 24, 2024. It is now read-only.
This repository was archived by the owner on Jun 24, 2024. It is now read-only.

perf: add benchmarks #132

Open
Open
@jon-chuang

Description

@jon-chuang

#4 mentions doing benchmarking. We should add some microbenchmarks to show the words per second v.s. llama.cpp. In fact, we should use a similar benchmarking methodology to llama.cpp to get an apples to apples comparison.

Metadata

Metadata

Assignees

No one assigned

    Labels

    issue:documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions