Skip to content

Issues: premAI-io/benchmarks

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

17 Open 90 Closed
17 Open 90 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Max Engine by Mojo
#188 opened Jun 1, 2024 by Anindyadeep
Incorrect results reported for TensorRT-LLM
#187 opened May 17, 2024 by lopuhin
5
aphrodite-engine
#186 opened May 15, 2024 by Anindyadeep
Use exllamav2's smart 4-bit KV cache for memory benchmark
#185 opened May 14, 2024 by Interpause
1
Add model loading time for each benchmarks medium priority
#181 opened Apr 24, 2024 by Anindyadeep
@Anindyadeep
Add torch.inference_session on runner function medium priority
#180 opened Apr 24, 2024 by Anindyadeep
@Anindyadeep
New engines
#156 opened Feb 4, 2024 by ogencoglu
Additional command line argument --clean for clean installation. low priority
#143 opened Jan 25, 2024 by Anindyadeep
@Anindyadeep
PowerInfer low priority
#105 opened Dec 20, 2023 by filopedraz
MLX high priority
#89 opened Dec 7, 2023 by Anindyadeep
Check if flash attention is supported on the issue or not, and accordingly update on the benchmark specific readme medium priority
#83 opened Dec 4, 2023 by Anindyadeep
@Anindyadeep
2
JAX low priority
#81 opened Dec 4, 2023 by Anindyadeep
2
gpt-fast medium priority
#74 opened Nov 30, 2023 by nsosio
@Anindyadeep
1
Include batch inference for all the frameworks for what concerns GPU inference enhancement New feature or request
#67 opened Nov 21, 2023 by filopedraz
HF Leaderboard enhancement New feature or request
#65 opened Nov 20, 2023 by filopedraz
@nsosio
Ollama medium priority
#43 opened Nov 15, 2023 by nsosio
3
tvm medium priority
#27 opened Nov 15, 2023 by nsosio
1
ProTip! Adding no:label will show everything without a label.