Gamified Adversarial Prompting (GAP): Crowdsourcing AI-weakness-targeting data through gamification. Boost model performance with community-driven, strategic data collection
-
Updated
Oct 10, 2024 - Python
#
visual-instruction-tuning
Here are 11 public repositories matching this topic...
Visual Instruction Tuning towards General-Purpose Multimodal Model: A Survey
-
Updated
Feb 16, 2024
[ECCV2024] Reflective Instruction Tuning: Mitigating Hallucinations in Large Vision-Language Models
-
Updated
Jul 17, 2024 - Python
Vistral-V: Visual Instruction Tuning for Vistral - Vietnamese Large Vision-Language Model.
-
Updated
Jul 1, 2024 - Python
[EMNLP 2024] A Video Chat Agent with Temporal Prior
-
Updated
Sep 30, 2024 - Python
Mistral assisted visual instruction data generation by following LLaVA
mistral
multimodal-learning
llm
langchain
llava
vllm
visual-instruction-tuning
llama-cpp-python
instruction-following-data
-
Updated
Jun 5, 2024 - Python
🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
-
Updated
Dec 9, 2023 - Python
A collection of visual instruction tuning datasets.
-
Updated
Mar 14, 2024 - Python
A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, qwen-vl, qwen2-vl, phi3-v etc.
finetuning
multimodal
vision-language
foundation-models
instruction-tuning
large-language-model
llava
visual-instruction-tuning
multimodal-large-language-models
large-multimodal-models
qwen-vl
llava-next
-
Updated
Oct 22, 2024 - Python
[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"
-
Updated
Aug 5, 2024 - Python
✨✨Latest Advances on Multimodal Large Language Models
multi-modality
instruction-following
in-context-learning
large-language-models
chain-of-thought
instruction-tuning
visual-instruction-tuning
large-vision-language-model
multimodal-instruction-tuning
large-vision-language-models
multimodal-large-language-models
multimodal-in-context-learning
multimodal-chain-of-thought
-
Updated
Oct 29, 2024
Improve this page
Add a description, image, and links to the visual-instruction-tuning topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the visual-instruction-tuning topic, visit your repo's landing page and select "manage topics."