Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MT-DNN not working in a translation of squad #162

Open
ju-resplande opened this issue Apr 7, 2020 · 0 comments
Open

MT-DNN not working in a translation of squad #162

ju-resplande opened this issue Apr 7, 2020 · 0 comments

Comments

@ju-resplande
Copy link

When using a Portuguese Translation of squad 1.1 with initial checkpoint as neuralmind/bert-base-portuguese-cased, the prediction step throws a KeyError specifically in squad_utils.py extract_answer function:

image

Noticing that the error was related to questions with biggest context paragraph, I set +10 in DOC_STRIDE in prepro_std.py and, additionally, executed training with batch_size = 20. The first epoch ran without errors, however in the second about 7 KeyErrors errors related to these answers bound were encountered. I tried increasing DOC_STRIDE in 20, 30, 40, 50 and it still did not work.

The dataset was also run on hugging face using run_squad.py without errors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant