Search results

Free tensors from RAM if they are offloaded to an Accelerator

issue:enhancementNew feature or requestNew feature or request

topic:clblasthttps://github.com/CNugteren/CLBlast supporthttps://github.com/CNugteren/CLBlast support

topic:cublashttps://developer.nvidia.com/cublas supporthttps://developer.nvidia.com/cublas support

topic:metalhttps://developer.apple.com/metal/ supporthttps://developer.apple.com/metal/ support

Status: Open.

#390 In rustformers/llm;

· LLukas22 opened on Jul 27, 2023

Runtime GPU backend selection

issue:enhancementNew feature or requestNew feature or request

topic:api-designAPI design considerations, including new functionality and changesAPI design considerations, including new functionality and changes

topic:clblasthttps://github.com/CNugteren/CLBlast supporthttps://github.com/CNugteren/CLBlast support

topic:cublashttps://developer.nvidia.com/cublas supporthttps://developer.nvidia.com/cublas support

topic:metalhttps://developer.apple.com/metal/ supporthttps://developer.apple.com/metal/ support

Status: Open.

#386 In rustformers/llm;

· philpax opened on Jul 23, 2023

Multi-GPU support for inferencing

issue:enhancementNew feature or requestNew feature or request

topic:clblasthttps://github.com/CNugteren/CLBlast supporthttps://github.com/CNugteren/CLBlast support

topic:cublashttps://developer.nvidia.com/cublas supporthttps://developer.nvidia.com/cublas support

Status: Open.

#371 In rustformers/llm;

· philpax opened on Jul 16, 2023

Using gpu is slower as not using it

issue:enhancementNew feature or requestNew feature or request

topic:cublashttps://developer.nvidia.com/cublas supporthttps://developer.nvidia.com/cublas support

Status: Open.

#357 In rustformers/llm;

· sonic182 opened on Jul 6, 2023

cuBLAS error

issue:bugSomething isn't workingSomething isn't working

os:linuxRelated to LinuxRelated to Linux

topic:cublashttps://developer.nvidia.com/cublas supporthttps://developer.nvidia.com/cublas support

Status: Open.

#347 In rustformers/llm;

· cometyang opened on Jul 3, 2023