New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for Lite-Mistral-Instruct chat template #8522

Closed

AmgadHasan wants to merge 1 commit into ggerganov:master from AmgadHasan:Lite-Mistral-Instruct-Chat-Template

AmgadHasan commented Jul 16, 2024

I have read the contributing guidelines
Self-reported review complexity:
- Low
- Medium
- High

This PR adds support for the chat template used by OuteAI/Lite-Mistral-150M-v2-Instruct

The chat template is as follows:

<s>system
[System message]</s>
<s>user
[Your question or message]</s> 
<s>assistant
[The model's response]</s>

It is very similar to ChatML, the only difference is the special tokens that delimit the roles.
Let me know if there are any issues.


          Add support for Lite-Mistral-Instruct chat template

c140bc1

github-actions bot added the testing label

AmgadHasan mentioned this pull request

Feature Request: Add support for Lite-Mistral-Instruct chat template #8529

Closed

4 tasks

Author

AmgadHasan commented Jul 18, 2024

Update:
Looks like this template is already implemented with the name monarch
https://github.com/ggerganov/llama.cpp/wiki/Templates-supported-by-llama_chat_apply_template

AmgadHasan closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

testing