#

minicpm

Here is 1 public repository matching this topic...

inferflow / inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

bloom falcon moe gemma mistral mixture-of-experts model-quantization multi-gpu-inference m2m100 llamacpp llm-inference internlm llama2 qwen baichuan2 mixtral phi-2 deepseek minicpm

Updated Mar 15, 2024
C++

Improve this page

Add a description, image, and links to the minicpm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the minicpm topic, visit your repo's landing page and select "manage topics."