Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
preminstrel authored Jun 26, 2024
1 parent 64a9a60 commit 968ef73
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -110,6 +110,6 @@ If you find TriForce useful or relevant to your project and research, please kin
```

## FAQ
1. Environment Issues
1. **Environment Issues**

Ensure you are using `transformers==4.37.2` because the apply_rotary_pos_emb API has changed in more recent versions of transformers. Additionally, some environment issues (e.g., incompatibility with the latest flash-attn) can be resolved by setting `torch==2.2.1+cu121` and `flash_attn==2.5.7`. For more details, please refer to [issue #7](https://github.com/Infini-AI-Lab/TriForce/issues/7).
Ensure you are using `transformers==4.37.2` because the apply_rotary_pos_emb API has changed in more recent versions of transformers. Additionally, some environment issues (e.g., incompatibility with the latest flash-attn) can be resolved by setting `torch==2.2.1+cu121` and `flash_attn==2.5.7`. For more details, please refer to [issue #7](https://github.com/Infini-AI-Lab/TriForce/issues/7).

0 comments on commit 968ef73

Please sign in to comment.