Skip to content
This repository was archived by the owner on Oct 11, 2024. It is now read-only.

Commit 044b670

Browse files
mgointlrmchlsmth
authored andcommitted
Enable bfloat16 for sparse_w16a16 (#18)
1 parent 6143ab9 commit 044b670

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/sparsity/sparse_w16a16.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ def get_name(cls) -> str:
3131

3232
@classmethod
3333
def get_supported_act_dtypes(cls) -> List[torch.dtype]:
34-
return [torch.half]
34+
return [torch.float16, torch.bfloat16]
3535

3636
@classmethod
3737
def get_min_capability(cls) -> int:

0 commit comments

Comments
 (0)