Skip to content

Multi model backend support for Ollama, OpenAI, Gemini & Claude with human-like friendly chat abilities#44

Merged
itsskofficial merged 1 commit intomasterfrom
development
Mar 3, 2025
Merged

Multi model backend support for Ollama, OpenAI, Gemini & Claude with human-like friendly chat abilities#44
itsskofficial merged 1 commit intomasterfrom
development

Conversation

@itsskofficial
Copy link
Contributor

🚀 Summary

This PR includes changed backend functionality to enable multi model backend support for switching between local Ollama models and cloud based models like OpenAI, Gemini & Claude. It also contains prompt engineering changes for enabling friendly chat between any model and the user

✅ Related Issues

Closes #17 #21 #24

🔍 Changes Made

  • Feature 🚀 Multi model support for Ollama
  • Feature 🚀 Multi model support for cloud based models
  • Feature 🚀 Multi model support for cloud based models
  • Refactor ♻️ Frontend improvements in home, settings and sidebar

📸 Screenshots (if applicable)

image

🔄 Additional Context

Now user can switch models from the settings page. For cloud based models, they need to enter their own API key

…human-like friendly chat abilities (#43)

* added multi-model switching logic for ollama

* readme changes

Co-authored-by: Kabeer2004 <merchantkabeer68@gmail.com>

* fix: moved api key setting logic to python backend

* feat: model selector in onboarding

* feat: structured output support for cloud models

* fix: added self.messages property

* fix: updated selected model logic

* fix: runnable model mapping logic updates (WIP)

* fix: added default state to self.messages

* fix: added self.system_prompt_template

* fix: structured outputs in agents with cloud providers (WIP)

* fix: working on agents fix

* fix: elaborator response structure

* fix: updated runnables with working logic (WIP)

* feat:
widget teaser - added reminder widget to show what widgets on home screen will look like
chat page - added current model selected feature
sidebar - revamped sidebar. started as an experiment, went in for a full revamp
settings page - added API key management features - delete or add keys manually for your models

fix:
multiple bugfixes

* fix: chat message icons

* fix: resolved elaborator issue

---------

Co-authored-by: Kabeer2004 <merchantkabeer68@gmail.com>
@itsskofficial itsskofficial added the merge Merging branches label Mar 3, 2025
@itsskofficial itsskofficial added this to the 1.5.0 milestone Mar 3, 2025
@itsskofficial itsskofficial self-assigned this Mar 3, 2025
@itsskofficial itsskofficial merged commit 4632732 into master Mar 3, 2025
3 of 5 checks passed
@github-actions github-actions bot locked and limited conversation to collaborators Mar 3, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

merge Merging branches

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEATURE] Multi-model support for ollama

1 participant