You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, the Classifier-Free Guidance Logits processor need re-run the model forward process with unconditional_ids in comput_logits process, how to make this happen in vLLM?
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!
🚀 The feature, motivation and pitch
Implementation in transformers: https://github.com/huggingface/transformers/blob/6b22a8f2d8ded6b2a681e1c078b0e1abf27d045c/src/transformers/generation/logits_process.py#L2171
Hi, the Classifier-Free Guidance Logits processor need re-run the model forward process with unconditional_ids in comput_logits process, how to make this happen in vLLM?
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: