Skip to content

Commit 16b714d

Browse files
BlackBird-Codingjimpang
authored andcommitted
[Bugfix] Fix KeyError: 1 When Using LoRA adapters (vllm-project#5164)
1 parent 29c5a5c commit 16b714d

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/core/scheduler.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -423,7 +423,9 @@ def _schedule_running(
423423
num_running_seqs = seq_group.get_max_num_running_seqs()
424424
budget.subtract_num_seqs(seq_group.request_id,
425425
num_running_seqs)
426-
if curr_loras is not None and seq_group.lora_int_id > 0:
426+
427+
if (curr_loras is not None and seq_group.lora_int_id > 0
428+
and seq_group.lora_int_id in curr_loras):
427429
curr_loras.remove(seq_group.lora_int_id)
428430

429431
if running_queue:

0 commit comments

Comments
 (0)