Skip to content

Commit

Permalink
Update CHANGELOG
Browse files Browse the repository at this point in the history
  • Loading branch information
ZJaume committed Mar 27, 2023
1 parent 4a9a1ad commit 23c52ee
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,18 +4,19 @@ All notable changes to this project will be documented in this file.
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).

## Unreleased:
## Bicleaner AI 2.2.0:
### Added
- Support tokenizing by characters (useful for Chinese).
- CLI option to configure minimum words/tokens to be omited/replaced.

### Changed
- Refactored Tokenizer class.
- Update HF hub.
- Create only one Tokenizer object per process in noise function.
- Removed external tokenizer option.
- Improved begginers guide.

### Fixed
- Create only one Tokenizer object per process in noise function.

## Bicleaner AI 2.1.0:
### Added
Expand Down

0 comments on commit 23c52ee

Please sign in to comment.