[Inference]Add fused rotary kernel and get cos cache kernel#5302
Merged
CjhHa1 merged 4 commits intohpcaitech:feature/colossal-inferfrom Jan 24, 2024
Merged
[Inference]Add fused rotary kernel and get cos cache kernel#5302CjhHa1 merged 4 commits intohpcaitech:feature/colossal-inferfrom
CjhHa1 merged 4 commits intohpcaitech:feature/colossal-inferfrom
