Search results

example of integrating deepspeed fastgen into TorchServe

example

future

Status: Open.

#2780 In pytorch/serve;

· lxning opened on Nov 9, 2023

· 

v1.0.0

update deepspeed opt example

documentationImprovements or additions to documentationImprovements or additions to documentation

enhancementNew feature or requestNew feature or request

example

gpu

large-model

llm

pythonPull requests that update Python codePull requests that update Python code

Status: Open.

#2614 In pytorch/serve;

· lxning opened on Sep 22, 2023

asr whisper model in torchserve

example

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2578 In pytorch/serve;

· navaneethakarli opened on Sep 8, 2023

Failure in loading Deepspeed large model example

example

questionFurther information is requestedFurther information is requested

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2569 In pytorch/serve;

· sachanub opened on Sep 5, 2023

Update examples for Accelerated Transformers/SDPA

documentationImprovements or additions to documentationImprovements or additions to documentation

example

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2284 In pytorch/serve;

· chauhang opened on Apr 28, 2023

Update the requirement list for text_classification example

bugSomething isn't workingSomething isn't working

example

triagedIssue has been reviewed and triagedIssue has been reviewed and triaged

Status: Open.

#2100 In pytorch/serve;

· agunapal opened on Jan 31, 2023