Skip to content

Commit ac9c7f3

Browse files
winglianArthurZucker
authored andcommitted
mark llama4 as not supported with fa2 (#37416)
1 parent 894783c commit ac9c7f3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/models/llama4/modeling_llama4.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -490,7 +490,7 @@ class Llama4PreTrainedModel(PreTrainedModel):
490490
config_class = Llama4Config
491491
supports_gradient_checkpointing = True
492492
_skip_keys_device_placement = ["past_key_values"]
493-
_supports_flash_attn_2 = True
493+
_supports_flash_attn_2 = False
494494
_supports_sdpa = True
495495
_supports_flex_attn = True
496496
_supports_cache_class = True

0 commit comments

Comments
 (0)