Dataset & Pretrained model Release
Pre-release
Pre-release
This release contains the preprocessed WikiText-S,F and WikiFacts dataset and the pretrained model weights for Transformer-XL based models for WikiText-S, F.
t-xl_wt-f_model17.pt
: Transformer-XL based LRLM trained on WikiText-F.t-xl_wt-s_model12.pt
: Transformer-XL based LRLM trained on WikiText-S.