support Qwen 3 and Qwen 3 MoE #3922
Description
Describe the feature
Please describe the feature requested here(请在这里描述需求)
Paste any useful information
Paste any useful information, including papers, github links, etc.(请在这里描述其他有用的信息，比如相关的论文地址，github链接等)
ref: huggingface/transformers#36878
ref: InternLM/lmdeploy#3305
Additional context
Add any other context or information here(其他信息可以写在这里)