[Request] ollama options add num_ctx if custom model maxToken is set.

[bingoct]

🥰 Feature Description

Need a way to set n_ctx by custom. num_ctx is 2048 length in default.

As #1244 define the CUSTOM_MODELS type. Infact the describtion of maxToken is close to usage of num_ctx.

Or Maybe use another variable?

🧐 Proposed Solution

lobe-chat/src/libs/agent-runtime/ollama/index.ts

Line 42 in fef62d6

const response = await this.client.chat({

maybe if model.tokens exist ,then options add item n_ctx: model.tokens

📝 Additional Information

https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values
https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-specify-the-context-window-size

[lobehubbot]

👀 @bingoct

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。