Skip to content

docs: publish Qwen3.8 27B 5070 Ti recipe - #3

Merged
feveromo merged 4 commits into
mainfrom
qwen-5070ti-recipe
Aug 20, 2026
Merged

docs: publish Qwen3.8 27B 5070 Ti recipe#3
feveromo merged 4 commits into
mainfrom
qwen-5070ti-recipe

Conversation

@feveromo

Copy link
Copy Markdown
Owner

Publishes the measured local-inference recipe from the Aug 19 optimization session.

Kept it self-contained under recipes/qwen3.8-27b-5070ti/ so the Pi Chisel project docs stay clean.

Includes:

  • the actual 5070 Ti / 9800X3D / 32 GB setup
  • controlled before/after numbers
  • the auto-fit bottleneck
  • embedded MTP n=2 config
  • adaptive VRAM launcher
  • systemd example
  • benchmark script
  • the stuff that lost: Q8 KV, bigger batches, Q2_K, Q4_K, NVFP4, DFlash2

@feveromo
feveromo merged commit 908aba3 into main Aug 20, 2026
2 checks passed
@feveromo
feveromo deleted the qwen-5070ti-recipe branch August 20, 2026 01:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant