Skip to content
Back to pull request #7072

gguf-split: add --no-tensor-first-split option #1120

Sign in to view logs

gguf-split: add --no-tensor-first-split option

gguf-split: add --no-tensor-first-split option #1120

Run time

Learn about OS pricing on GitHub Actions
Job Run time
bench-server-baseline (phi-2, q4_0)
14m 10s
bench-server-baseline (phi-2, q8_0)
14m 11s
bench-server-baseline (phi-2, f16)
14m 16s
42m 37s