Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Nan of P score? #173

Open
xukefaker opened this issue Oct 28, 2023 · 0 comments
Open

Nan of P score? #173

xukefaker opened this issue Oct 28, 2023 · 0 comments

Comments

@xukefaker
Copy link

I run this line:
P, R, F1 = bert_score.score(cands, refs, lang='en', verbose=True, model_type='roberta-large', num_layers=17)

and I got nan of P score, but not for R and F1 score. what does this mean?

python cal_bert_score.py
'''
using bert-score version: 0.3.12
calculating scores...
computing bert embedding.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 213/213 [01:18<00:00, 2.72it/s]
computing greedy matching.
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 115/115 [00:03<00:00, 36.60it/s]
done in 81.80 seconds, 89.50 sentences/sec
System level F1 score: 0.731
System level P score: nan
System level R score: 0.836
'''

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant