New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Could you please help to optimize miniCPM3-4B? #12029

Open

violet17 opened this issue Sep 6, 2024 · 1 comment

Assignees

Labels

violet17 commented Sep 6, 2024

I can run miniCPM3-4b, but it is a little slow on MTL iGPU.
Could you please help to optimize miniCPM3-4B?
Thanks.

qiuxin2012 added the user issue label

MeouSker77 self-assigned this

Contributor

MeouSker77 commented Sep 11, 2024

please try latest ipex-llm, it should be much faster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment