Skip to content

[LLM:Bugfix] Pass calibration input IDs to AWQ position IDs - #4806

Merged
wangzhaode merged 1 commit into
alibaba:masterfrom
ZedingZhang:feature/awq-multimodal-position-ids
Sep 1, 2026
Merged

wangzhaode merged 1 commit into
alibaba:masterfrom
ZedingZhang:feature/awq-multimodal-position-ids

Conversation

@ZedingZhang

Copy link
Copy Markdown
Contributor

Description

Fixes #4804

Module

LLM

Type

  • Feature
  • Bugfix
  • Perf
  • Refact
  • Style
  • Doc
  • Test
  • Chore

Validation

  • Ran a focused Python regression harness with a multimodal-style get_position_ids implementation. It reproduced the original None.flatten failure before the change, then verified that the exact calibration input IDs are forwarded and AWQ initialization completes after the change.
  • python -m py_compile transformers/llm/export/utils/awq_quantizer.py
  • git diff --check

A full Qwen2.5-VL AWQ export was not run locally; this PR only claims the initial missing-input fix above.

Checklist

  • Commit message follows [Module:Type] Description format
  • Code compiles without errors
  • Tested on relevant platform(s)
  • No unrelated format or style changes included

@wangzhaode wangzhaode self-assigned this Sep 1, 2026
@wangzhaode
wangzhaode merged commit e8a3e6d into alibaba:master Sep 1, 2026
1 check passed
@ZedingZhang
ZedingZhang deleted the feature/awq-multimodal-position-ids branch September 17, 2026 08:35
ZedingZhang added a commit to ZedingZhang/MNN that referenced this pull request Sep 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

AWQ quantizer crashes on multimodal models: get_position_ids() called without input_ids

2 participants