Skip to content

Qwen2VLConfig and Qwen2_5_VLConfig have no attribute hidden_size #1012

@Tcc0403

Description

@Tcc0403

🐛 Describe the bug

self = Qwen2_5_VLConfig {
  "image_token_id": 32768,
  "model_type": "qwen2_5_vl",
  "text_config": {
    "attention_dropout"..."window_size": 112
  },
  "vision_end_token_id": 32766,
  "vision_start_token_id": 32765,
  "vision_token_id": 32767
}

key = 'hidden_size'

    def __getattribute__(self, key):
        if key != "attribute_map" and key in super().__getattribute__("attribute_map"):
            key = super().__getattribute__("attribute_map")[key]
>       return super().__getattribute__(key)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
E       AttributeError: 'Qwen2_5_VLConfig' object has no attribute 'hidden_size'

Reproduce

Run

python -m pytest test/convergence/bf16/test_mini_models.py -k "qwen2_vl or qwen2_5_vl"

Versions

transfomers==v5.0.0rc2

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions