Skip to content

Conversation

@Jeerhz
Copy link
Contributor

@Jeerhz Jeerhz commented Nov 14, 2024

Summary

This update introduces support for selecting the ollama:llava multimodal model within the game, enhancing the player experience with visual analysis capabilities. It poses the bases for adding subsequent multimodal models.

Previous Functionality

Previously, the game used classic text models, generating a text-based context prompt from game data algorithmically. This approach focused solely on textual inputs for determining moves.

New Functionality

With this update, players can now load a multimodal model. The ollama:llava model directly analyzes in-game images, producing a list of moves based on visual input.

Copy link
Contributor

@oulianov oulianov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great addition Jeerhz ! A few fixups left, and then we can be good to go 👍

@Jeerhz Jeerhz requested a review from oulianov November 15, 2024 13:49
Copy link
Contributor

@oulianov oulianov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Love it

@oulianov oulianov merged commit 0778134 into OpenGenerativeAI:main Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants