Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero shot classification #619

Closed
wants to merge 8 commits into from

Conversation

abratnap
Copy link

@abratnap abratnap commented Mar 22, 2024

Describe the contribution to the taxonomy

  • Adds a skill for classifying user queries based on class descriptions
  • Zero shot classification which can be tuned based on description

Input given at the prompt

   ...

Response from the original model

  ...

Response from the fine-tuned model

  ...

Contribution checklist

@abratnap abratnap requested a review from a team as a code owner March 22, 2024 17:21
Signed-off-by: Abhay Ratnaparkhi <abhay.ratnaparkhi1@ibm.com>
Signed-off-by: Abhay Ratnaparkhi <abhay.ratnaparkhi1@ibm.com>
abhayibm and others added 4 commits March 22, 2024 12:37
Signed-off-by: Abhay Ratnaparkhi <abhay.ratnaparkhi1@ibm.com>
Signed-off-by: Abhay Ratnaparkhi <abhay.ratnaparkhi1@ibm.com>
Signed-off-by: Abhay Ratnaparkhi <abhay.ratnaparkhi1@ibm.com>
@github-actions github-actions bot added triage-needed (Auto labeled) skill is ready to be triaged skill (Auto labeled) labels Mar 27, 2024
Copy link
Member

@mingxzhao mingxzhao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have changed the attribution requirements and no longer require them within the yaml file. Please remove them when you can!

@mingxzhao mingxzhao added triage-requested-changes skill has been reviewed; changes requested from contributor and removed triage-needed (Auto labeled) skill is ready to be triaged labels Apr 5, 2024
Signed-off-by: Abhay <abhay.ratnaparkhi@gmail.com>
@github-actions github-actions bot added the triage-needed (Auto labeled) skill is ready to be triaged label Apr 5, 2024
@jjasghar
Copy link
Member

jjasghar commented Apr 5, 2024

This feels like it should be a knowledge with references instead of context on it. The context is written and opinionated, where a knowledge would be referenced trusted information.

@abratnap
Copy link
Author

abratnap commented Apr 5, 2024

This feels like it should be a knowledge with references instead of context on it. The context is written and opinionated, where a knowledge would be referenced trusted information.

The concept is to enhance the ability to classify text into categories based on class descriptions in real-time. While LLM can already manage this, I believe adding a specific skill would further improve its performance in such tasks.

@jjasghar
Copy link
Member

jjasghar commented Apr 7, 2024

We will be discussing this in our skill triage meeting soon. Thank you for the feedback.

Can you rebase the branch too please?

@jjasghar
Copy link
Member

jjasghar commented Apr 8, 2024

We have decided that the "guard rails" for this type of work should come from the core engineering team. Thank you for your submission, but this will PR will fall into a larger initiative, and we can not accept this.

@jjasghar jjasghar closed this Apr 8, 2024
@abratnap
Copy link
Author

abratnap commented Apr 8, 2024

We have decided that the "guard rails" for this type of work should come from the core engineering team. Thank you for your submission, but this will PR will fall into a larger initiative, and we can not accept this.

okay. thank you for reviewing it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
skill (Auto labeled) triage-needed (Auto labeled) skill is ready to be triaged triage-requested-changes skill has been reviewed; changes requested from contributor
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants