From 968ef73993e075e34d54c58b7984ace3f54b3133 Mon Sep 17 00:00:00 2001 From: Hanshi Sun Date: Wed, 26 Jun 2024 00:51:39 -0400 Subject: [PATCH] Update README.md --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index fec45a3..b09b127 100644 --- a/README.md +++ b/README.md @@ -110,6 +110,6 @@ If you find TriForce useful or relevant to your project and research, please kin ``` ## FAQ -1. Environment Issues +1. **Environment Issues** -Ensure you are using `transformers==4.37.2` because the apply_rotary_pos_emb API has changed in more recent versions of transformers. Additionally, some environment issues (e.g., incompatibility with the latest flash-attn) can be resolved by setting `torch==2.2.1+cu121` and `flash_attn==2.5.7`. For more details, please refer to [issue #7](https://github.com/Infini-AI-Lab/TriForce/issues/7). + Ensure you are using `transformers==4.37.2` because the apply_rotary_pos_emb API has changed in more recent versions of transformers. Additionally, some environment issues (e.g., incompatibility with the latest flash-attn) can be resolved by setting `torch==2.2.1+cu121` and `flash_attn==2.5.7`. For more details, please refer to [issue #7](https://github.com/Infini-AI-Lab/TriForce/issues/7).