[Bugfix][Hardware][Intel CPU] Fix unpassed multi_modal_kwargs for CPU runner (vllm-project#5956)

Isotr0py · Alvant · commit 26eb509398ba · 2024-10-26T09:38:30.000+03:00
Signed-off-by: Alvant &lt;alvasian@yandex.ru&gt;
diff --git a/vllm/worker/cpu_model_runner.py b/vllm/worker/cpu_model_runner.py
@@ -355,6 +355,7 @@ def prepare_model_input(
             input_positions=input_positions,
             attn_metadata=attn_metadata,
             sampling_metadata=sampling_metadata,
+            multi_modal_kwargs=multi_modal_kwargs,
         )
 
     @torch.inference_mode()

Original file line number	Diff line number	Diff line change
`@@ -355,6 +355,7 @@ def prepare_model_input(`
`355`	`355`	`input_positions=input_positions,`
`356`	`356`	`attn_metadata=attn_metadata,`
`357`	`357`	`sampling_metadata=sampling_metadata,`
	`358`	`+ multi_modal_kwargs=multi_modal_kwargs,`
`358`	`359`	`)`
`359`	`360`
`360`	`361`	`@torch.inference_mode()`