MLX-VLM a package for running Vision LLMs on your Mac using MLX.
The easiest way to get started is to install the mlx-vlm
package:
With pip
:
pip install mlx-vlm
Inference:
python -m mlx_vlm.generate --model qnguyen3/nanoLLaVA --max-tokens 100 --temp 0.0