Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GFN LLM FineTuning #191

Open
josephdviviano opened this issue Oct 9, 2024 · 0 comments
Open

GFN LLM FineTuning #191

josephdviviano opened this issue Oct 9, 2024 · 0 comments

Comments

@josephdviviano
Copy link
Collaborator

We need to re-implement this paper as part of the torchgfn library: https://github.com/GFNOrg/gfn-lm-tuning

In particular many quality of life improvements would be welcome, such as being able to initialize a policy from a huggingface model with a clean API, etc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant