What's Changed
- Fix source tokens for HF fast tokenizers by @ddaspit in #133
- Add environment variable to dockerfiles to skip pip install by @mshannon-sil in #134
- Update to support Python 3.9-3.12 by @TaperChipmunk32 in #131
- fix docker build by @johnml1135 in #136
- Fix USX corpus issues by @ddaspit in #138
- fix deprecated tokenizer methods, add test cases by @mshannon-sil in #139
- Fix moses punct by @johnml1135 in #140
- Automatically run poetry install and set default python on devcontainer startup by @mshannon-sil in #143
- Raise error when id tag doesn't match filename book id by @mshannon-sil in #141
- Update learning rate for #116 and other small error by @johnml1135 in #117
- Update to macOS-13 by @johnml1135 in #147
Full Changelog: v1.2.0...v1.4.1