Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: support Classifier-Free Guidance Logits processor #5245

Closed
zhaoyinglia opened this issue Jun 4, 2024 · 2 comments
Closed

[Feature]: support Classifier-Free Guidance Logits processor #5245

zhaoyinglia opened this issue Jun 4, 2024 · 2 comments

Comments

@zhaoyinglia
Copy link

zhaoyinglia commented Jun 4, 2024

🚀 The feature, motivation and pitch

Implementation in transformers: https://github.com/huggingface/transformers/blob/6b22a8f2d8ded6b2a681e1c078b0e1abf27d045c/src/transformers/generation/logits_process.py#L2171

Hi, the Classifier-Free Guidance Logits processor need re-run the model forward process with unconditional_ids in comput_logits process, how to make this happen in vLLM?

Alternatives

No response

Additional context

No response

Copy link

This issue has been automatically marked as stale because it has not had any activity within 90 days. It will be automatically closed if no further activity occurs within 30 days. Leave a comment if you feel this issue should remain open. Thank you!

Copy link

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant. Thank you!

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Nov 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant