Skip to content

Conversation

@rlancemartin
Copy link
Collaborator

@rlancemartin rlancemartin commented Nov 23, 2023

1/ Create datasets for semi-structured eval
2/ Benchmark several methods

@rlancemartin rlancemartin marked this pull request as draft November 24, 2023 23:00
@rlancemartin rlancemartin changed the title Add semi-structured eval example Add semi-structured, multi-modal eval Dec 1, 2023
@rlancemartin rlancemartin changed the title Add semi-structured, multi-modal eval Add semi-structured Dec 7, 2023
@rlancemartin rlancemartin changed the title Add semi-structured Add semi-structured eval Dec 7, 2023
@rlancemartin rlancemartin marked this pull request as ready for review December 11, 2023 19:36
@rlancemartin
Copy link
Collaborator Author

Ensemble example needs:
langchain-ai/langchain#14552

Copy link
Collaborator

@hinthornw hinthornw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should introduce a new level of the docs to support the other experiments for a given dataset/task

@rlancemartin rlancemartin merged commit 13e7f2d into main Dec 12, 2023
@rlancemartin rlancemartin deleted the rlm/ss_eval_test branch December 12, 2023 22:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants