[Binary] Mistral model not configured properly

[Janaka-Steph]

[filopedraz]

It's about the prompt template you are using. @biswaroop1547 @nsosio @casperdcl should we have a prompt_template field in the manifest?

[casperdcl]

I think @biswaroop1547 is going to hardcode a fixed template for OpenOrca.

in future maybe having a configurable prompt might be part of this manifest.json proposal

[biswaroop1547]

added a solution for current chat services (only implemented and working for Mistral models) - premAI-io/prem-services#124
Requesting reviews 🙏🏻