Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问可以上传到ollama的模型仓库上吗 #2

Open
michael19960921 opened this issue Apr 20, 2024 · 9 comments
Open

请问可以上传到ollama的模型仓库上吗 #2

michael19960921 opened this issue Apr 20, 2024 · 9 comments

Comments

@michael19960921
Copy link

我是一个刚刚接触大模型的新手,目前用ollama在本地运行起了llama3。
我还不太熟悉 hugging face。所以我希望大佬可以上传一个到ollama的模型仓库,帮助我快速体验到它。谢谢

@UnicomAI
Copy link
Owner

我是一个刚刚接触大模型的新手,目前用ollama在本地运行起了llama3。 我还不太熟悉 hugging face。所以我希望大佬可以上传一个到ollama的模型仓库,帮助我快速体验到它。谢谢

我们研究下

@michael19960921
Copy link
Author

@UnicomAI 非常感谢你,期待你的好消息

@quqiangsheng
Copy link

同求,需求很热,我们用ollama部署很方便

@LGinC
Copy link

LGinC commented Apr 23, 2024

还有LM studio

@ambiguoustexture
Copy link

ambiguoustexture commented Apr 24, 2024

可以 huggingface .bin -> llama.cpp GGUF -> Ollama 这个路径来做。
huggingface_hub 下载下来后,使用 python3 ../llama.cpp/convert.py [local_dir] --vocab-type bpe --outfile llama3-8b-chinese.gguf 进行转换,然后再按照 Ollama 的文档来就行:

$ cat ./Modelfile
FROM ./llama3-8b-chinese.gguf

# set the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature 1

# set the system message
# SYSTEM """
#
# """

$ ollama create llama3-8b-chinese -f Modelfile
$ ollama run llama3-8b-chinese
>>>

@zhqfdn
Copy link

zhqfdn commented Apr 26, 2024

Modelfile 这个模板要对应 这个模型的配置,否则会有点问题

@xx025
Copy link

xx025 commented Apr 26, 2024

@michael19960921
@quqiangsheng

我在Ollama 社区上传了一个我制作的

https://ollama.com/ollam/unichat-llama3-chinese-8b

详细可见:#8 (comment)

@michael19960921
Copy link
Author

@michael19960921 @quqiangsheng

我在Ollama 社区上传了一个我制作的

https://ollama.com/ollam/unichat-llama3-chinese-8b

详细可见:#8 (comment)

谢谢你。我会尝试下

@GuSanle
Copy link

GuSanle commented Apr 30, 2024

@michael19960921 @quqiangsheng

我在Ollama 社区上传了一个我制作的

https://ollama.com/ollam/unichat-llama3-chinese-8b

详细可见:#8 (comment)

是28k的新的吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants