-
Notifications
You must be signed in to change notification settings - Fork 389
Open
Labels
Description
Context / Scenario
We've been trying to use KM for AI chat stuff with mixed results and it took me a while to figure out why. We see lots of 'input truncated, context size exceeded' type errors in the ollama logs, but we're setting the numctx. It does nothing, as does every single other option you expose for Ollama. None of them do anything, because YOU HAVE THAT CODE COMMENTED OUT!
What happened?
I expected the options to get passed to Ollama, they don't.
Importance
I cannot use Kernel Memory
Platform, Language, Versions
C#, latest KM, Windows
Relevant log output
kernel-memory/extensions/Ollama/Ollama
/OllamaTextGenerator.cs, line 139 to 143 are commented out, WHY?!? This makes KM completely useless for us.