Skip to content

Dataset & Pretrained model Release

Pre-release
Pre-release
Compare
Choose a tag to compare
@rooa rooa released this 07 Feb 23:12
· 6 commits to master since this release

This release contains the preprocessed WikiText-S,F and WikiFacts dataset and the pretrained model weights for Transformer-XL based models for WikiText-S, F.

  • t-xl_wt-f_model17.pt: Transformer-XL based LRLM trained on WikiText-F.
  • t-xl_wt-s_model12.pt: Transformer-XL based LRLM trained on WikiText-S.