Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

code is incomplete in main.py line 332。 #2

Open
scarydemon2 opened this issue Jan 19, 2022 · 3 comments
Open

code is incomplete in main.py line 332。 #2

scarydemon2 opened this issue Jan 19, 2022 · 3 comments

Comments

@scarydemon2
Copy link

the evaluate func is define as : def evaluate(data_loader, model, paradigm, task, sents):
but parameter not passed in :

dev_result = evaluate(dev_loader, model, args.paradigm, args.task)

It seems that the eval process is not finished, can you add the complete code?

@CodeWang-Ay
Copy link

you can try below code like test code :
sents, _ = read_line_examples_from_file(f'data/{args.task}/{args.dataset}/dev.txt')
dev_result = evaluate(dev_loader, model, args.paradigm, args.task, sents)

@IsakZhang
Copy link
Owner

Thanks @kingbuff for answering the question. Since I did not use "do_eval" in the final experiment, I forgot to change the code of that part when releasing. You can modify that part similar to "do_direct_eval". I will update the code later when I have more free time. Thanks.

@CodeWang-Ay
Copy link

Do the experimental results of the ASTE task in your paper report a development set or a test set?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants