[Question]: Model Ollama cannot connect

[ginisksam]

Describe your problem

But LLM limited. Got Ollama - Mistral instance running at 127.0.0.1:11434 but cannot add Ollama as model in RagFlow. Please assist. This software is very good and flexible for document split-chunk-semantic for embedding. Many thanks

[KevinHuSh]

Do you mean on the demo Website or locally deployed?
If on the demo Website, 127.0.0.1 is a not accessible IP. Make sure the server deploying Ollama has an internet accessible IP address.
If you deploy RAGFlow locally, make sure both Ollama and RAGFlow in the same LAN that can comunicate eachother.
A correct Ollama IP and Port is the key.

[ginisksam]

locally deployed. The error is as flws:

hint : 102
Fail to access model(mistral).ERROR: [Errno 111] Connection refused

As you know Ollama is really popular now for local machine.

OK, I got your msg. IP on same LAN is key.
Will try restart Ollama as root and try OLLAMA_HOST=0.0.0.0:11434 ollama serve

Thanks

[shaoxinghua0623]

Hello, I got the same problem.

hint : 102
Fail to access model(qwen:14b).ERROR: [Errno 111] Connection refused

I modified Environment="OLLAMA_HOST=0.0.0.0"
And when I try 0.0.0.0:11434 on browser, it showed ollama is running.

I couldn't add model on the web.
Could you help me, thx.

[mjiulee]

感谢大神~~

尝试了下，ollama链接不成功，但是打开：否是否支持 Vision后，可以添加成功。

但是，在chat选项里面，没列初ollama的选项，应该是假象。

聊天配置，没得选刚才添加的ollama模型

希望大神完善下。

[shaoxinghua0623]

Yes, I got the same promble with you. @mjiulee

[mjiulee]

@shaoxinghua0623

我又尝试了遍，神奇的可以了。

就是把url换成你装ollama的服务器的ip地址就行，例如：http://192.168.0.100:11434

然后就ok了~

[shaoxinghua0623]

@mjiulee

真的，谢谢兄弟！

[matheospower]

@shaoxinghua0623
I have the same issue on Ubuntu 22.04 . Did the above resolve your issue?
If yes can you please help me how to find the appropriate IP for Ollama url?

[shaoxinghua0623]

@matheospower
you can use the command ifconfig on the terminal to find the IP of Ubuntu.
And the ollama base url is http://IP of your Ubuntu:11434.
IP of your Ubuntu is not 0.0.0.0 or 127.0.0.1

[matheospower]

@matheospower you can use the command ifconfig on the terminal to find the IP of Ubuntu. And the Ollama base url is http://IP of your Ubuntu:11434. IP of your Ubuntu is not 0.0.0.0 or 127.0.0.1

Thank you for the answer! Unfortunately, this did not resolve my problem. Not sure If I need to open a new issue but I will post it here.

My problem is that I get stuck in the pop-up to add an Ollama model. I tested the Ollama service (running), from outside and inside the ragflow-server with curl, and seems fine and can be reached. After setting the url in the pop-up and clicking ok, it is loading for some time and then gives me a connection time-out. Also I cannot see anything in the docker logs -f ragflow-server or the rag flow-logs directory.

If anyone had a similar issue or can give a hint on how to troubleshoot please let me know!

[fredrousseau]

Hi , same issue there .... I did test using http://host.docker.internal:11434/ as a base url ( that's probably the way to go specially in a docker deployment model) but I got an error "Hint 102 : Fail to access model(/mistral).ERROR: [Errno -2] Name or service not known " ...

[fredrousseau]

Found a way to solve that issue , I had to change my ollama settings to "Environment="OLLAMA_HOST=PRIVATEIP" to get it exposed ... it looks like if you listen on the loopback (127.0.0.1) ragflow is not able to reach it

[ShawnHoo7256]

Solve this Problem：

1. Make sure Ollama is OK.
2. Config as follow:

[ginisksam]

Found a way to solve that issue , I had to change my ollama settings to "Environment="OLLAMA_HOST=PRIVATEIP" to get it exposed ... it looks like if you listen on the loopback (127.0.0.1) ragflow is not able to reach it

Kool. Will give it a try.

FINDINGS:
Just discovered that my existing ollama working well with langchain is not at root level.

If I edit my ollama.service file and set Environment="OLLAMA_HOST=PRIVATEIP" and systemctl start ollama.service - In browser PRIVATEIP:11434 => ollama is running. Fine.

But in terminal - ollama list - all the models are missing!!!
Case in point - Can ollama resides in root and user - and serve at root or user level separately at any one time? Will not affect each other?
OS: Linux Mint 21.3 (newbie)