qwen support long chat

[allenhaozi]

support long chat Support Longchat #555 has been merged
This does not support qwen yet.

If I refer to qwen's ntk_alpha method, can vllm support qwen's long chat? thank you

[allenhaozi]

QwenLM/Qwen#398

[allenhaozi]

@LiuXiaoxuanPKU @zhuohan123 @WoosukKwon Can you give me some suggestions? thank you
If it works, I would like to contribute this pr

[Sanster]

rope_scaling support for qwen has already been merged into the main branch: #1210

"rope_scaling": {
    "type": "dynamic",
    "factor": 2.0
  }

[allenhaozi]

rope_scaling support for qwen has already been merged into the main branch: #1210

"rope_scaling": {
    "type": "dynamic",
    "factor": 2.0
  }

@Sanster Thank you for your reply

There are some differences in the implementation of qwen ntk,
I would like to discuss it
If it works, I would like to contribute this pr