Implement conversation context and streaming with OllamaSharp

[kborowinski]

PR Summary

This PR refactors the AIShell.Ollama.Agent to use the OllamaSharp library, enhancing functionality and maintainability. Key updates include support for conversation context, streaming, improved settings management, and better error handling.

Important:
If you choose this PR, then close Implement settings file for Ollama agent

PR Context

This update improves the AIShell.Ollama.Agent by:

1. Switching to OllamaSharp:

   • Simplifies API calls with OllamaApiClient.
   • Supports both streaming and non-streaming responses.

2. Introducing Context Support:

   • Enables the agent to remember previous responses, improving conversational flow.

3. Enhancing Configuration Management:

   • Manages settings via ollama.config.json with real-time updates using FileSystemWatcher.
   • Provides a sample configuration file to simplify setup.

4. Improving Chat Interaction:

   • Adds robust error handling, especially when prerequisites (like the Ollama server) are not met.
   • Validates settings (e.g., Model and Endpoint) to ensure proper functionality.
   • Supports local and remote Ollama endpoints

This PR also aligns with prerequisites outlined in issue #155 and improves the user experience with clearer feedback and enhanced features.

[daxian-dbw]

@kborowinski Thanks for making improvements to the ollama agent!

[daxian-dbw]

Suggested change

	host.MarkupWarningLine($"[[{Name}]]: Please be sure the Ollama is installed and server is running. Check all the prerequisites in the README of this agent are met.");
	host.WriteErrorLine($"[{Name}]: Please be sure the Ollama is installed and server is running. Check all the prerequisites in the README of this agent are met.");

[daxian-dbw]

Also, given that the prompt will be @ollama when the agent is in use, maybe we don't need to include the [{Name}] part in the error message.

[kborowinski]

BTW, I think we should check if ollama is running only when the Endpoint is set to localhost. This will enable support for remote ollama endpoints.

if (IsLocalHost().IsMatch(_client.Uri.Host) && Process.GetProcessesByName("ollama").Length is 0)
{
    host.WriteErrorLine("Please be sure the Ollama is installed and server is running. Check all the prerequisites in the README of this agent are met.");
    return false;
}

and

/// <summary>
/// Defines a generated regular expression to match localhost addresses
/// "localhost", "127.0.0.1" and "[::1]" with case-insensitivity.
/// </summary>
[GeneratedRegex("^(localhost|127\\.0\\.0\\.1|\\[::1\\])$", RegexOptions.IgnoreCase)]
internal partial Regex IsLocalHost();

[daxian-dbw]

I have saved the OllamaSharp package to the MS feed (we're required to use it only), so you can revert the changes in this file.

[kborowinski]

The OllamaSharp was just updated to 4.0.8 and you do not have this version on the MS feed yet, so I will keep it for the moment. I guess in the future you will pull it automatically to the MS feed.

[kborowinski]

@daxian-dbw Thank you very much for your time and the review. I did implement the changes you required. If you have any additional suggestions, please let me know.

[kborowinski]

@daxian-dbw Apologies for the repeated pings. Please take a look whenever you have a chance.

[daxian-dbw]

Sorry for the delay. I’m out of town this week and hopefully will be back next Tuesday. I will get to the PR right away after I'm back.

…

________________________________ From: Kris Borowinski ***@***.***> Sent: Thursday, November 28, 2024 5:36:49 PM To: PowerShell/AIShell ***@***.***> Cc: Dongbo Wang ***@***.***>; Mention ***@***.***> Subject: Re: [PowerShell/AIShell] Implement conversation context and streaming with OllamaSharp (PR #310) @daxian-dbw<https://github.com/daxian-dbw> Apologies for the repeated pings. Please take a look whenever you have a chance. — Reply to this email directly, view it on GitHub<#310 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AAA7DWWK5VN3RGQWFGM4DKT2C3P3DAVCNFSM6AAAAABSHKI72WVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKMBVGY3DEMJTG4>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[StevenBucher98]

This is AWESOME @kborowinski ! Thanks for the contributions! Will definitely make the Ollama agent better 😄 I will work to modify the agent creation instructions to either comply with these changes or keep the old code since it may serve better as example, thanks again!

[daxian-dbw]

All look good! I made a couple minor changes to the style, nothing big. Thanks again @kborowinski!