Skip to content

[TENSORRT-LLM] - Implement new looper thread based backend#2357

Merged
Narsil merged 63 commits intomainfrom trtllm-executor-threadOct 25, 2024

Commits

Commits on Oct 21, 2024

Commits on Oct 22, 2024

Commits on Oct 25, 2024