-
Notifications
You must be signed in to change notification settings - Fork 1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Run programs with multiple beams #117
Comments
Beam search is not currently supported, but I don't think there is any reason why it couldn't be. Happy to review any PRs. (or course this would only be for open models, since if an endpoint does not support beam search there is no way to add it) |
I'm excited about this! I think it makes sense to start in the transformer model class. Can you potentially give me one or two starting points to get up to speed quickly? |
Sure. Right now we call the generate command. We should be able to just pass the appropriate beam search options to the transformers I would just start though by trying to add the params and pass them right to transformers and then see if it works :) |
@marcotcr @slundberg up on this issue, especially for |
Describe the solution you'd like
I want to run programs with multiple beams and choose one or many beams with the highest score according to my LM.
.
The text was updated successfully, but these errors were encountered: