Feature request: local network ollama; handling <think> yapping

[spiralparagon]

Thank you for this great addition to RStudio! I'm testing it out using a local llm with 'thinking' abilities, and the verboseness in qmd files is extraordinary. However, it does get 'covered' in tags, so I'm curious if the function keep that part out of the end-result could be eliminated (or commented). Secondly, would it be possible to setup so that one can use a network url for the ollama instance?

All the best,

[simonpcouch]

Absolutely, thanks for the issue! Related to #30.

Instead of ignoring things inside of <think></think>, I'm kind of curious about the opposite, where gander could instruct the model to only return things it intends to be inlined into the document inside of some <response></response> or similar and then gander just doesn't do anything until it sees that tag. Many potential issues there, but feels worth exploring.

re:

Secondly, would it be possible to setup so that one can use a network url for the ollama instance?

Do correct me if I'm misunderstanding, but gander can support any model supported by ellmer. If using a network URL is indeed not possible with ellmer, you'll need to file an issue there.