NanoChat.ai is a cross-platform GUI application built on Electron that allows you to chat with small but powerful chat language models. The inference is implemented in pure C++ and is fast even on lower-end devices, e.g 4GB RAM and dual-core CPU thanks to 8-bit and 4-bit inference. Currently existing models:
- MiniCPM source, license
- Zephyr1.6b
- TinyLlama-1.1B-Chat-v0.4.
To build NanoChat, the following dependencies are required:
- Node.js and npm version v20.11.0 and v10.2.4 (or higher) respectively.
- Electron which can be installed via npm by the following command:
npm install --save-dev electron@latest. - Cmake version 3.0 or higher.
Once you have the required dependecies run the following commands to install and launch the app and enjoy!
git clone https://github.com/iangitonga/nanochat.ai.git
cd nanochat.ai/
npm install
npm start