Skip to content

Commit 46284b7

Browse files
committed
precommit
Signed-off-by: JartX <sagformas@epdcenter.es>
1 parent 0dabbf1 commit 46284b7

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

vllm/model_executor/models/qwen2_5_vl.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -424,6 +424,7 @@ def forward(
424424
elif self.attn_backend == _Backend.TORCH_SDPA:
425425
# Execute attention entry by entry for speed & less VRAM.
426426
from vllm.platforms import current_platform
427+
427428
if current_platform.is_rocm():
428429
q = q.contiguous()
429430
k = k.contiguous()

vllm/model_executor/models/qwen2_vl.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -454,6 +454,7 @@ def forward(
454454
elif self.attn_backend == _Backend.TORCH_SDPA:
455455
# Execute attention entry by entry for speed & less VRAM.
456456
from vllm.platforms import current_platform
457+
457458
if current_platform.is_rocm():
458459
q = q.contiguous()
459460
k = k.contiguous()

0 commit comments

Comments
 (0)