Skip to content

Commit

Permalink
[Bugfix][Hardware][Intel CPU] Fix unpassed multi_modal_kwargs for CPU…
Browse files Browse the repository at this point in the history
… runner (vllm-project#5956)
  • Loading branch information
Isotr0py authored and prashantgupta24 committed Jun 28, 2024
1 parent 779e4e0 commit cd41d94
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/worker/cpu_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -355,6 +355,7 @@ def prepare_model_input(
input_positions=input_positions,
attn_metadata=attn_metadata,
sampling_metadata=sampling_metadata,
multi_modal_kwargs=multi_modal_kwargs,
)

@torch.inference_mode()
Expand Down

0 comments on commit cd41d94

Please sign in to comment.