Add Unigram tokenizer needed by T5 and FLAN-T5 model families #13264
| Job | Run time |
|---|---|
| 2m 18s | |
| 8m 46s | |
| 2m 51s | |
| 2m 42s | |
| 1m 43s | |
| 3m 43s | |
| 13m 37s | |
| 5m 0s | |
| 11m 26s | |
| 2m 14s | |
| 8m 21s | |
| 2m 32s | |
| 5m 52s | |
| 1m 51s | |
| 3m 31s | |
| 1m 50s | |
| 2m 20s | |
| 6m 34s | |
| 11m 26s | |
| 1m 35s | |
| 7m 35s | |
| 6m 6s | |
| 6m 55s | |
| 28m 55s | |
| 5m 44s | |
| 7m 37s | |
| 32m 8s | |
| 7m 23s | |
| 7m 8s | |
| 9m 8s | |
| 18m 0s | |
| 16m 56s | |
| 8m 37s | |
| 7m 16s | |
| 1m 26s | |
| 8m 12s | |
| 16m 51s | |
| 6m 8s | |
| 2m 36s | |
| 11m 25s | |
| 3m 49s | |
| 0s | |
| 5h 20m 7s |