Search results

Support for KV-Cache quantizations

Status: Open.

#17 In RahulSChand/gpu_poor;

· ivanbaldo opened on Jun 17, 2025

How to get list of model names and architecture details programmatically? How did you populate all_configs.json

Status: Open.

#16 In RahulSChand/gpu_poor;

· jag89 opened on Dec 10, 2024

Could I offer some assistance with the front-end development?

Status: Open.

#15 In RahulSChand/gpu_poor;

· feiandxs opened on Oct 10, 2024

How to calculate token_per_second_by_GPU, there are specific formula instructions？

Status: Open.

#14 In RahulSChand/gpu_poor;

· 01lin opened on Sep 12, 2024

What's the meaning of magic numbers?

Status: Open.

#11 In RahulSChand/gpu_poor;

· flei2019 opened on Jan 16, 2024

Missing License

Status: Open.

#10 In RahulSChand/gpu_poor;

· RabbitTwin opened on Jan 13, 2024

compute in gpu_configs.json meaning

questionFurther information is requestedFurther information is requested

Status: Open.

#8 In RahulSChand/gpu_poor;

· RaccoonOnion opened on Dec 4, 2023

API to use this repo

enhancementNew feature or requestNew feature or request

Status: Open.

#4 In RahulSChand/gpu_poor;

· RaccoonOnion opened on Nov 5, 2023