Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is multi-token iPET be able to trained on a multi-class classification dataset? #82

Open
GryffindorLi opened this issue Mar 5, 2022 · 2 comments

Comments

@GryffindorLi
Copy link

Hi, I want to adapt muti-token iPET to a multi-classification task. However, all examples in the paper are binary classification. I am wondering can iPET be trained for multi-classification tasks?

@chris-aeviator
Copy link

I remember Timo Schick mentioning that this is not possible yet somewhere in this repository a while ago.

I used plain Bert to train my multi classification task

@XiaoqingNLP
Copy link

XiaoqingNLP commented Nov 23, 2022

@GryffindorLi @chris-aeviator I think it is possible to support multiple categories.
Initially, I understand that PET can be used on multiple tokens, so it should be able to be adapted to multi-category tasks.
Besides PET, I can think of two ways to use it, but I'm not sure which one will work better

  1. classify multi-categories by number 1-N (N>10) and then predict the number to classify? This will lose semantic information
  2. splice the multiclassification labels after the text as a generation task and let the model do the generation of the labels?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants