🚨 [Ernie 4.5 VL Moe] Fix up namings to vllm/sglang convention#44299
🚨 [Ernie 4.5 VL Moe] Fix up namings to vllm/sglang convention#44299vasqu merged 19 commits intohuggingface:mainfrom
Ernie 4.5 VL Moe] Fix up namings to vllm/sglang convention#44299Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
|
run-slow: ernie4_5_vl_moe |
|
This comment contains models: ["models/ernie4_5_vl_moe"] |
|
run-slow: ernie4_5_vl_moe |
|
This comment contains models: ["models/ernie4_5_vl_moe"] |
| model="baidu/ERNIE-4.5-VL-28B-A3B-PT", | ||
| device_map="auto", | ||
| revision="refs/pr/10", | ||
| revision="refs/pr/11", |
There was a problem hiding this comment.
New revision because the old one had a merge conflict and I had no idea how to resolve it, mirrored it basically
| ``` | ||
|
|
||
| ## Ernie4_5_VL_MoeConfig | ||
| ## Ernie4_5_VLMoeConfig |
There was a problem hiding this comment.
VL_Moe <-> VLMoe to match sglang and vllm
| # NOTE: Slightly different from `model_type` (to follow naming conventions in vllm/sglang) | ||
| "ernie4_5_vlmoe", |
There was a problem hiding this comment.
Weird case where we check for the model class name so it's not the same as model type, just as a note no to be confused
There was a problem hiding this comment.
These are dependent on the hub so CI might be red if people are currently working
|
[For maintainers] Suggested jobs to run (before merge) run-slow: auto, ernie4_5_vl_moe |
|
Force merging this since it is blocking CI; run slow passed everything and BC alias runs as well |
…ingface#44299) * rename * small fix and and adjust converter * oops * try * docs * fix tests * last one? * revisions * fixup naming for ckpt conversion needed for norm * trigger ci fresh * aliases with classes because modular doesnt pick it up otherwise * style * so many exceptions * fix * when does it end * small fixup * add bc name to conversion mapping as well
2 participants
As per title, to allow for proper alignment with vllm/sglang
Closes #44258