Skip to content

Stop the generation when <|eom_id|> token is encountered (needed for llama 3.1 tool call support)#8858

Merged
fairydreaming merged 5 commits intoggerganov:masterfrom fairydreaming:handle-eom-tokenAug 5, 2024