pd with nixl backend#856

Open

kingder wants to merge 24 commits intoModelTC:mainfrom

kingder:pd_nixl

Commits on Jul 11, 2025

WIP.
Weichao Luo
committed
working.
Weichao Luo
committed
prefill abort -> notify decode.
Weichao Luo
committed
fix long connect time.
Weichao Luo
committed
nixl pd.
Weichao Luo
committed
fixup.
Weichao Luo
committed
fixup.
Weichao Luo
committed
rename.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
support dp for pd_nixl
Weichao Luo
committed
chunk transfer.
Weichao Luo
committed
fix max_new_token.
Weichao Luo
committed
rename args and update request state with list.
Weichao Luo
committed
update & add docker
Weichao Luo
committed
fix.
Weichao Luo
committed
fix lint.
Weichao Luo
committed
fix abort.
Weichao Luo
committed
fix prefill num_tokens > decode num_tokens

shihaobai
authored and
Weichao Luo
committed
fix chunked transfer & bugs.
Weichao Luo
committed
fix chunked transfer.
Weichao Luo
committed
paged transfer.
Weichao Luo
committed
rebase main.
Weichao Luo
committed
fix lint.
Weichao Luo
committed

Commits on Jul 14, 2025

fix.
Weichao Luo
committed