[Feature] Model FalconH1

[Swipe4057]

Checklist

• 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 2. Please use English, otherwise it will be closed.

Motivation

Please support the Falcon H1 model series. Support is already available in vLLM and transformers!

Related resources

https://falcon-lm.github.io/blog/falcon-h1/
vllm-project/vllm#18406
huggingface/transformers#38249

[KivenChen]

SGL doesn’t yet support Mamba layers / ops. How’s Falcon H1 performing in your workload?

[dhiaEddineRhaiem]

Hey @Swipe4057 ,
Thanks for your interest in FalconH1 models.

We will soon raise a PR to first support Mamba2 then FalconH1 in sglang.