TypeError: LlamaSdpaAttention.forward() got an unexpected keyword argument 'truthx_model'

[Angelo3357]

当我从huggingface上下载模型llama2-7b-chat-truthX后 运行text.py时会出现如下错误，请问该如何解决？

[XavierZhang2002]

This issue occurs because the "sdpa" method (LlamaSdpaAttention) is being used, and it seems that TruthX does not support this method. Therefore, you can manually set it to "eager" mode (LlamaAttention) as a workaround.