Skip to content

Conversation

@rlancemartin
Copy link
Collaborator

  • Example notebooks for eval of multi-modal RAG w/ mm-embd and mv-retriever vs baseline top-k RAG
  • To Do: create public benchmark

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ideally we don't check these into the repo and either use LFS or GCS

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya, I'm removing now that we are creating the public dataset.

@hinthornw
Copy link
Collaborator

Fixed up the paths and notebook

@rlancemartin
Copy link
Collaborator Author

Fixed up the paths and notebook

Nice. I will further clean both both notebook and add comments / context.

@rlancemartin rlancemartin force-pushed the rlm/multi-modal-benchmark branch from 12b2aef to eb703c0 Compare December 5, 2023 19:18
@hinthornw hinthornw merged commit 013fe6a into main Dec 5, 2023
@hinthornw hinthornw deleted the rlm/multi-modal-benchmark branch December 5, 2023 20:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants