New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Minicpm-V-2.6 Llama.cpp and Ollama Support #11887

Open

RobinJing opened this issue Aug 21, 2024 · 1 comment

Assignees

Labels

RobinJing commented Aug 21, 2024

Hi,

Minicpm-V is a very popular model these days, although it has not been supported by the current version of llama.cpp and ollama, please refer to the following submission:
ollama/ollama#6417
https://github.com/ggerganov/llama.cpp/releases/tag/b3598
BR

jason-dai added the user issue label

hkvision assigned rnwang04

Contributor

rnwang04 commented Aug 27, 2024

Hi @RobinJing ,
ipex-llm‘s ollama is upgrade to 0.3.6 with ipex-llm[cpp]>=2.2.0b20240827, you may have a try with latest llama.cpp / ollama 😊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment