Open
Description
🚀 The feature
Provide an example of integrating deepspeed fastgen in TorchServe.
Motivation, pitch
deepspeed fastgen was published in mii.
Alternatives
No response
Additional context
No response
{{ message }}
No type
No projects
None yet
No branches or pull requests