UI to query any Ollama model using local models

Prerequisites

Download Ollama: ollama.com/download

Download a Model: ollama.com/library

After downloading, run the model locally:

  ollama run [model_name_here]

Note: This project uses llama3.1. If you want to use a different model, you need to change the model in server.py

Set Up

Clone the project

  git clone https://github.com/KashyapTan/LLM-Query-UI.git

Install React dependencies

  npm install

Install Server requirements

  pip install -r requirements.txt

Start local host

  npm run dev

Start python server

  python server.py