llama : add pre-tokenizer regexes for BLOOM and gpt3-finnish (#8850) #14365
Job | Run time |
---|---|
14m 44s | |
18m 50s | |
52m 26s | |
1h 48m 17s | |
1h 51m 33s | |
2h 29m 56s | |
35m 25s | |
36m 13s | |
12m 59s | |
14m 19s | |
9h 14m 42s |
Job | Run time |
---|---|
14m 44s | |
18m 50s | |
52m 26s | |
1h 48m 17s | |
1h 51m 33s | |
2h 29m 56s | |
35m 25s | |
36m 13s | |
12m 59s | |
14m 19s | |
9h 14m 42s |