Skip to content

Commit 01b250b

Browse files
youkaichaoIsotr0py
authored andcommitted
[ci] fix gh200 tests (vllm-project#11919)
Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Isotr0py <2037008807@qq.com>
1 parent 5583e3b commit 01b250b

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

vllm/model_executor/model_loader/weight_utils.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,9 @@
2929

3030
try:
3131
from runai_model_streamer import SafetensorsStreamer
32-
except ImportError:
32+
except (ImportError, OSError):
33+
# see https://github.com/run-ai/runai-model-streamer/issues/26
34+
# OSError will be raised on arm64 platform
3335
runai_model_streamer = PlaceholderModule(
3436
"runai_model_streamer") # type: ignore[assignment]
3537
SafetensorsStreamer = runai_model_streamer.placeholder_attr(

0 commit comments

Comments
 (0)