-
Notifications
You must be signed in to change notification settings - Fork 446
Closed
Labels
Description
🐛 Describe the bug
CI details: Qwen2VLConfig, monkey patch impl related
Text config is seperated out from the general config in transformers>=4.52.0.
Qwen2VLRotaryEmbedding takes Qwen2VLTextConfig intead of Qwen2VLConfig now.
huggingface/transformers#37268
We also need to check all VLMs monkey patch since most models are refactored into TextModel and VisionModel
blocked on: huggingface/transformers#38331 (can walkaround by passing hidden_size and vocab_size to config dict directly though) fixed by huggingface/transformers#38372
Reproduce
No response
Versions
liger_kernel==0.5.9
transformers>=4.52.0