support swift deploy stats

[Jintao-Huang]

PR type

• Bug Fix
• New Feature
• Document Updates
• More Models or Datasets Support

1. 文档更新：推理时如何自定义val_dataset; megatron如何转换qwen2-72b-instruct
2. 支持部署时显示统计量. 部署新增参数verbose, log_interval. 控制多久打印一次统计量.
3. megatron中安装对应版本的megatron-lm (使用commit-hash控制)，保证稳定性
4. 修复lmdeploy部署时的bug. session_id导致的并发低的问题.
5. 部署时，支持base模型使用chat/completions 接口.
6. megatron部分重构函数注册部分, 方便新增模型
7. 新增get_model_list_client_async.

English:

1. Document update: How to customize val_dataset during inference; How to convert qwen2-72b-instruct in Megatron.
2. Support displaying metrics during deployment. Added parameters verbose and log_interval to control how often metrics are printed.
3. Ensure stability by installing the corresponding version of megatron-lm in Megatron (controlled using commit hash).
4. Fixed bug during lmdeploy deployment. Resolved the concurrency issue caused by session_id.
5. During deployment, support the base model using chat/completions interface.
6. Partially refactored function registration in Megatron to facilitate adding new models.
7. Added get_model_list_client_async.