AIChat

Generate conversations between two LLMs on any topic using the OpenAI API. You can mix and match models from Ollama, MLX, Claude, OpenAI, Google AI Studio, etc. that uses OpenAI API. It uses Kokoro-ONNX for TTS.

Conversation Demo: https://www.youtube.com/watch?v=FgSZLZnYlAE

Usage

1. Specify base_url, api_key, model, etc. in config.toml.
2. Customize the topic and system prompt for each model in config.toml.

For example, the entire prompt for a_model will be assembled as:

a_system_prompt = f"""{system_prompt}
{topic}
{a_profile}"""

Then a_model wil receive the intro message to start.

Run the following to setup and initiate a chat.

python3 -m venv .venv
# Linux/mac
source .venv/bin/activate
# Windows: .venv\scripts\activate
pip install -r requirements.txt
python chat.py