[WIP] Test for sequence parallel

[GhostScreaming]

PR types

Others

PR changes

Others

Description

Sequence Parallel逐位对齐代码。LLaMA 规模缩减到1层，mp_degree = 2，第一个step，动手SP与动半SP能够逐位对齐（前向每层输出和反向params.grad）。基于PR 7609

[paddle-bot]

Thanks for your contribution!

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.
0 out of 3 committers have signed the CLA.

❌ wuhuachaocoding
❌ GhostScreaming
❌ liuzhenhai93
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。

[github-actions]

This Pull Request is stale because it has been open for 60 days with no activity. 当前Pull Request 60天内无活动，被标记为stale。