MLX Chat

Chat interface for MLX for on-device Language Model use on Apple Silicon. Built on FastMLX.

Features:

• Plaintext file upload
• chat history download
• file download
  • example: download an ICS calendar file the model has created for you
• streaming chat

Using

1. (Install fastmlx: pip3 install mlx-lm fastmlx==0.2.1)
2. (Install model(s): run infra.py to view supported/installed models, modify & run infra-add.py to download & install new model)
3. pip3 install -r requirements.txt
4. `python3 ./app.py``
5. Check output, open "local URL" in browser
6. Enter/select locally available model to chat with