I have added offline support for LMStudio in the code！Can we directly update the proxy warehouse?

[bbcoll5219]

I have added offline support for LMStudio in the code. LMStudio has a visual interface that is more convenient than Olama, but can I update the code directly? Do we still need permission from the original author?

2、Added Chinese option

3、Need to add timeout, otherwise it will timeout over time. Who knows where to add it?

[bbcoll5219]

However, I still haven't figured out how to use this code completion. Can anyone explain it with a picture?

[bbcoll5219]

This smart codeinsight only allows offline ollama to be used
If only I could join LLMstudio

[bbcoll5219]

Need to add timeout, otherwise it will timeout over time. Who knows where to add it?

[Cesar4D]

Hello @bbcoll5219, your contributions are really cool. I ask that you make a pull request with them so we can add them to the official project. Thank you.

[doneindelphi]

Need to add timeout, otherwise it will timeout over time. Who knows where to add it?

for @bbcoll5219 :
I'm not sure what your approach was, but if you haven't found it yet, its a property of TRequest. I made a copy of /Src/AI/DelphiAIDev.AI.ChatGPT.pas called /Src/AI/DelphiAIDev.AI.LMStudio.pas , then added " .timeout(300000) " on line 56 or so. Its obvious where to put it. Timeout() is in milliseconds, so 300,000 is 5 minutes. So far this has worked well for me.

Will you be submitting your mods to this parent project? I'm sure we'd all like to see them.

For myself, I wanted a standalone client (not delphi ide) for LM Studio, and it works but sometimes it truncates the answers even though the server is sending complete answers. Not sure where I'm going wrong, but working on it.

Anyway, hope this helps.

dmbz