You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The seq2seq implementation of mean and max pooling crashes using allennlp 2.7 and pytorch 1,8
The issue is that both mean and max pooling mask the encoded output by converting the original mask from bool to float and multiplying. This masked tensor is then passed to masked_mean or masked_max along with the float mask, but masked_mean or masked_max require a bool mask, 'masked_max` fails on the first line
The
seq2seq
implementation of mean and max pooling crashes using allennlp 2.7 and pytorch 1,8The issue is that both mean and max pooling mask the encoded output by converting the original mask from
bool
tofloat
and multiplying. This masked tensor is then passed tomasked_mean
ormasked_max
along with the float mask, butmasked_mean
ormasked_max
require a bool mask, 'masked_max` fails on the first linevector.masked_fill(~mask, min_value_of_dtype(vector.dtype))
It seems unnecessary in the first place to mask the embeddings since that's done in
masked_mean
ormasked_max
The text was updated successfully, but these errors were encountered: