Support LLama3.1

[0xRichardH]

• Ollama: https://github.com/ollama/ollama/blob/main/docs/api.md#chat-request-with-tools

Prompt

"please act as a dictionary, including the pronunciation, explanation, two examples of sentences, and one image. And the word is `incentivize`. please output the result in json format, the json keys are `word`, `pronunciation`, `definition`, `examples`, and `image`.

CURL request

curl http://localhost:11434/api/generate -d '{
  "model": "llama3.1",
  "prompt": "please act as a dictionary, including the pronunciation, explanation, two examples of sentences, and one image. And the word is `incentivize`. please output the result in json format, the json keys are `word`, `pronunciation`, `definition`, `examples`, and `image`.",
  "stream": false,
  "format": "json"
}'

JSON Response

{
  "word": "incentivize",
  "pronunciation": "/ɪnˈsɛntɪvaɪz/",
  "definition": "to give someone a reason or motivation to do something, especially by offering them benefits or rewards for their
efforts.",
  "examples": [
    "The company decided to incentivize its employees with bonuses for meeting sales targets.",
    "The government introduced policies to incentivize people to use public transport and reduce carbon emissions."
  ],
  "image": {
    "src": "https://upload.wikimedia.org/wikipedia/commons/thumb/3/38/Business_incentives.jpg/800px-Business_incentives.jpg",
    "alt": "Incentives for businesses"
  }
}

[thelazyoxymoron]

+1

Would love to get support for local models via ollama