[kernel] Add RMSLayerNorm triton kernel#5262

Merged

yuanheng-zhao merged 5 commits intohpcaitech:feature/colossal-inferfrom

LotsoTeddy:feat/kernels/fused_layerrmsnorm

Jan 18, 2024

Commits on Jan 12, 2024

Commits on Jan 16, 2024

Remove the logics of mean computations, and update the name of ther kernel functions and files
LotsoTeddy
committed

Commits on Jan 17, 2024

add benchmark of rms norm
LotsoTeddy
committed