Skip to content

CI failure due to transformers VLM change #723

@Tcc0403

Description

@Tcc0403

🐛 Describe the bug

CI details: Qwen2VLConfig, monkey patch impl related

Text config is seperated out from the general config in transformers>=4.52.0.
Qwen2VLRotaryEmbedding takes Qwen2VLTextConfig intead of Qwen2VLConfig now.

huggingface/transformers#37268

We also need to check all VLMs monkey patch since most models are refactored into TextModel and VisionModel

blocked on: huggingface/transformers#38331 (can walkaround by passing hidden_size and vocab_size to config dict directly though) fixed by huggingface/transformers#38372

Reproduce

No response

Versions

liger_kernel==0.5.9
transformers>=4.52.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions