Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Token classification is not working #105

Open
TekeshwarHirwani opened this issue Jun 26, 2023 · 2 comments
Open

Token classification is not working #105

TekeshwarHirwani opened this issue Jun 26, 2023 · 2 comments

Comments

@TekeshwarHirwani
Copy link

I have tried to run script of token classification and it showed an error that this script only works for fast tokenizer, I wanted to use biogpt for NER task, so any one have any idea how to fine-tune the model for that please let me know

@renqianluo
Copy link
Collaborator

Hi, you can format the task to a sequence-to-sequence format which is more convenient for the generative model.
For NER task, you can follow the format in this paper
We have tested it on BioGPT and it works well.

e.g.,
Input: Aspirin is tested in the experiment as the treatment to the patient.
Output: Aspirin is tested in the experiment as the treatment to the patient.

@TekeshwarHirwani
Copy link
Author

Thankyou for responding @renqianluo,

How can we perform few-shot learning in BioGPT for NER task ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants