You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
correct restart count tracking to use original request ID
- Move original_req_id lookup before restart count check
- Use original_req_id for restart count lookup instead of current req_id
- Fixes request ID collisions (was creating duplicate IDs like 0_0_restart_1)
- Fixes restart counter (was always showing restart vllm-project#1)
- Fixes KV cache leak (duplicate IDs prevented proper cleanup)
- Enhanced debug logging to show both original and current request IDs
0 commit comments