-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Pull requests: FlashML-org/FreeToken
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
feat(server): serve per-request inference metrics under --enable-metr…
#504
opened Sep 17, 2026 by
FantasticCode2019
Loading…
feat(deepseek_v4): serve image input on the V4-Flash-Vision release
#502
opened Sep 17, 2026 by
void-mckenzie
Loading…
perf(moe): single-launch prefill buffer invalidation without hidden sync
#500
opened Sep 17, 2026 by
alvarorsouza-arch
Loading…
feat(kvcache): host-RAM KV tier for sparse-attention models (--kv-host-pages)
#499
opened Sep 17, 2026 by
alvarorsouza-arch
Loading…
feat(qwen4_exp): support channel-wise fp8 dense weights and per-row PLE loaders
#498
opened Sep 17, 2026 by
alvarorsouza-arch
Loading…
fix(scheduler): wait for rank subscribers before first broadcast
#495
opened Sep 17, 2026 by
Cyber-Marty
Loading…
fix(swa): keep the prompt head's windowed KV so fan-out can reuse a shared prefix
#488
opened Sep 15, 2026 by
huhoo
Loading…
fix(server): hoist system messages to front for templates requiring system-first
#487
opened Sep 15, 2026 by
rafaeldrincon
Loading…
feat(scheduler): interleave decode steps into long prefill runs
#484
opened Sep 15, 2026 by
huhoo
Loading…
feat(server): expose POST /v1/tokenize endpoint for client-side token counting
feature
New feature or request
#477
opened Sep 14, 2026 by
rafaeldrincon
Loading…
feat(server): add --default-thinking-mode flag for server-wide thinking default
#476
opened Sep 14, 2026 by
rafaeldrincon
Loading…
fix(tokenizer): respect explicit enable_thinking=false even when tools present
#475
opened Sep 14, 2026 by
rafaeldrincon
Loading…
fix(engine): preserve greedy sampling in mixed batches
#471
opened Sep 14, 2026 by
taking-lying-flat
Contributor
Loading…
fix(models): preserve glm4 router correction bias in fp32
#469
opened Sep 14, 2026 by
taking-lying-flat
Contributor
Loading…
fix(engine): reject fa attention backend below sm_90 at config time
#468
opened Sep 14, 2026 by
SanjayS45
Loading…
fix(utils): tolerate coalesced msgpack frames in zmq pull queues
#466
opened Sep 14, 2026 by
Cyber-Marty
Loading…
fix(scheduler): match stop strings with incremental decoding
#464
opened Sep 14, 2026 by
taking-lying-flat
Contributor
Loading…
fix(server): loopback-bind the TP rendezvous store, add --dist-port
#461
opened Sep 13, 2026 by
shikhakath
Loading…
feat(models): support deepseek v4.1 with native fp8-fp4 kv storage
#460
opened Sep 13, 2026 by
ArqAlice
Loading…
docs(moe): report shared expert banks across replicas
#451
opened Sep 12, 2026 by
kuangrenaigc-stack
Loading…
Previous Next
ProTip!
Follow long discussions with comments:>50.