Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix pixtral image prompt order for doc VQA #99

Merged
merged 2 commits into from
Oct 22, 2024
Merged

Conversation

ndurner
Copy link
Contributor

@ndurner ndurner commented Oct 20, 2024

Puts image references at the beginning of the prompt to Pixtral to make prompting more natural - without using "following" which the API user is likely not aware of. Fixes #98.

@Blaizzy
Copy link
Owner

Blaizzy commented Oct 22, 2024

Thanks a lot, @ndurner!

This is a great catch 🔥

@Blaizzy
Copy link
Owner

Blaizzy commented Oct 22, 2024

Could you write pre-commit to clear the tests??

@Blaizzy
Copy link
Owner

Blaizzy commented Oct 22, 2024

Thanks a lot!

I will merge it.

The tests now are failing because of a bug with Github test env installing MLX and not the code.

@Blaizzy Blaizzy merged commit f0812b5 into Blaizzy:main Oct 22, 2024
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Pixtral text/image prompt order
2 participants