Skip to content

Uiuc vlm pr compressed fixed #511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
copybara-service merged 50 commits into from
Mar 16, 2026
Merged

Uiuc vlm pr compressed fixed #511

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
73e41a0
Add SigLIP and Paligemma code
Tianjiao-Yu Sep 8, 2025
191dbd7
Add multimodal support for Gemma 3
jxiong21029 Sep 13, 2025
756c3d6
Begin implementing VL-DPO trainer
immuntasir Sep 13, 2025
154c464
Add DPO demo
Tianjiao-Yu Sep 14, 2025
a583fbe
Add dpo_demo_gemma3_v2.ipynb
Tianjiao-Yu Sep 14, 2025
3880a16
Edit VL-DPO trainer
Tianjiao-Yu Sep 15, 2025
d48af92
Add fixes for dpo_demo_gemma3_v2.ipynb and create dpo_demo_gemma3_v3.…
Tianjiao-Yu Sep 16, 2025
969d930
Modify tests for vl_dpo_trainer
immuntasir Sep 22, 2025
100dea3
Begin integrating image inputs support in DPOTrainer
jxiong21029 Sep 25, 2025
611962d
Remove unused files and update vl_dpo_demo_gemma3
immuntasir Sep 29, 2025
f4038a9
restore siglip code (needed for multimodal Gemma models)
jxiong21029 Nov 1, 2025
d45d0d6
Add SigLIP and Paligemma code
Tianjiao-Yu Oct 10, 2025
5413a10
Add multimodal support for Gemma 3
jxiong21029 Sep 13, 2025
74de87a
Begin implementing VL-DPO trainer
immuntasir Sep 13, 2025
1c26c2f
Add DPO demo
Tianjiao-Yu Oct 10, 2025
4327978
Add dpo_demo_gemma3_v2.ipynb
Tianjiao-Yu Oct 10, 2025
9490b0f
Edit VL-DPO trainer
Tianjiao-Yu Oct 10, 2025
dc6510a
Add fixes for dpo_demo_gemma3_v2.ipynb and create dpo_demo_gemma3_v3.…
Tianjiao-Yu Oct 10, 2025
844c7a0
Modify tests for vl_dpo_trainer
immuntasir Sep 22, 2025
583194f
Begin integrating image inputs support in DPOTrainer
jxiong21029 Sep 25, 2025
e5e2c36
Remove unused files and update vl_dpo_demo_gemma3
immuntasir Sep 29, 2025
0a463ee
Fix: gemma3 modelconfig imported with wrong class name
Tianjiao-Yu Oct 10, 2025
f548009
Fix safetensors loading for multimodal Gemma3 models
jxiong21029 Nov 1, 2025
9220769
VL-DPO notebook fixes
jxiong21029 Nov 1, 2025
97fd343
fix
jxiong21029 Nov 1, 2025
6350957
More VL-DPO notebook fixes
jxiong21029 Nov 1, 2025
0c46733
Remove VLMSampler; move preprocess_image from generate/utils.py to VL…
jxiong21029 Nov 1, 2025
5d3ecec
Delete examples/dpo_demo_gemma3.ipynb
jxiong21029 Nov 1, 2025
8c3e370
Revert dpo_demo_gemma3.ipynb
jxiong21029 Nov 1, 2025
bed8fa7
Restore SigLIP
jxiong21029 Nov 1, 2025
afe0d52
Fix multimodal DPO by forwarding pixel_values through logp computation
Tianjiao-Yu Dec 15, 2025
9c118e8
Forward pixel_values in get_per_token_logps for multimodal DPO
Tianjiao-Yu Dec 15, 2025
369ef14
fix notebook example for multimodal demo
Tianjiao-Yu Dec 16, 2025
d170ceb
Fix merge conflicts
abheesht17 Jan 26, 2026
1c4d1ff
Add Gemma3 multimodal attention mask, update DPO trainer, remove unus…
Tianjiao-Yu Feb 6, 2026
6cbae3b
Merge remote-tracking branch 'upstream/main' into uiuc-vlm-pr-compres…
abheesht17 Mar 9, 2026
912ae53
Remove extraneous changes
abheesht17 Mar 9, 2026
7fcf453
Pipe images correctly to the model
abheesht17 Mar 9, 2026
b1ee6fe
Fix indentation
abheesht17 Mar 9, 2026
87c258d
Update DPO Trainer with changes made to main
abheesht17 Mar 9, 2026
69df224
Fix raw image inputs
abheesht17 Mar 9, 2026
06095f0
Clean up example
abheesht17 Mar 9, 2026
b8ae3f0
Rename example file
abheesht17 Mar 9, 2026
816037b
Small fixes
abheesht17 Mar 9, 2026
0e57a81
Merge branch 'google:main' into uiuc-vlm-pr-compressed-fixed
abheesht17 Mar 16, 2026
e0d21ec
Small fixes
abheesht17 Mar 16, 2026
f70c30e
Fixes
abheesht17 Mar 16, 2026
2ec56a1
Fix input construction
abheesht17 Mar 16, 2026
13b834d
Small doc-string edit
abheesht17 Mar 16, 2026
f9d4d85
Remove PIL
abheesht17 Mar 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading