[New Model]: moonshotai/Kimi-Audio-7B-Instruct

[engchina]

The model to consider.

Hopefully support https://huggingface.co/moonshotai/Kimi-Audio-7B-Instruct soon.

The closest model vllm already supports.

No response

What's your difficulty of supporting the model you want?

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

@courage17340 do you have plans to implement this as well?

[courage17340]

@courage17340 do you have plans to implement this as well?

I'm afraid not. I'm very busy these days.

[DarkLight1337]

As discussed in #17264, @tunglinwood feel free to implement this then

[tunglinwood]

As discussed in #17264, @tunglinwood feel free to implement this then

Well noted, thank you for the oppotunity. Could you kindly assign this issue to me? Thanks.

[zengqingfu1442]

Hope vllm to support this model.

[tunglinwood]

Hope vllm to support this model.

Hi I am currently working on it and will submit my PR soon. Thank you.

[lengyueyang]

mark

[lengyueyang]

thanks for your support, when will it be ready?

[tunglinwood]

thanks for your support, when will it be ready?

Sorry, I will pull in this coming holidays of China. Thank you.