[Inference]Support FP16/BF16 Flash Attention 2 And Add high_precision Flag To Rotary Embedding#5461
Merged
isky-cd merged 13 commits intohpcaitech:feature/colossal-inferfrom Mar 25, 2024
Commits
Commits on Mar 14, 2024
Commits on Mar 15, 2024
- committed
Commits on Mar 19, 2024
- committed
- committed
- committed