New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

更大模型进行编辑会报OOM问题 #30

Open

echo-valor opened this issue Jul 4, 2024 · 0 comments

echo-valor commented Jul 4, 2024

如何使用多卡进行编辑？使用--checkpointing 参数也会OOM，如13B 70B等

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment