[FT] better support for model loading args in transformers

[NathanHB]

Hi, i need to evaluate a model with SWA so i think i need to change the attention from spda => flash_attention or others since i get

Sliding Window Attention is enabled but not implemented for `sdpa`; unexpected results may be encountered.