Skip to content
#

pgo

Star

Here are 9 public repositories matching this topic...

Language: Python
Filter by language
All 53 Python 9 Go 8 C 7 Shell 6 Rust 4 Gleam 4 C# 2 C++ 2 CMake 1 JavaScript 1

doramirdor / mbolt

Star 5

Profile-guided layout optimization for llama.cpp GGUF MoE models — BOLT/PGO for LLM weights. Trace expert routing, rewrite the file so co-activated experts sit together, prefetch as merged reads.

metal moe bolt quantization model-serving pgo profile-guided-optimization inference-optimization mixture-of-experts edge-ai on-device-ai apple-silicon llama-cpp local-llm llm-inference gguf ssd-streaming expert-parallelism
  • Updated Jul 22, 2026
  • Python

Improve this page

Add a description, image, and links to the pgo topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the pgo topic, visit your repo's landing page and select "manage topics."

Learn more