Skip to content

Commit

Permalink
moar guide
Browse files Browse the repository at this point in the history
Signed-off-by: Matteo Collina <[email protected]>
  • Loading branch information
mcollina committed May 8, 2024
1 parent 45c259d commit ea9b7e6
Showing 1 changed file with 20 additions and 2 deletions.
22 changes: 20 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,12 +38,30 @@ Steps for downloading and setting up AI Warp for local development.
is located at `ai-warp-app/platformatic.json`. **Note: this will be overwrited
every time you generate the test app.**
8. Start the test app.
8. Start the test app. From the `app-warp-ai` folder, run:
```bash
npm start
node ../dist/cli/start.js
```
### Testing a local model with llama2
To test a local model with with llama2, you can use the following to downloaded a tested model:
```bash
curl -L -O https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF/resolve/main/mistral-7b-instruct-v0.2.Q8_0.gguf
```
Then, in your `platformatic.json` file, add:
```
"aiProvider": {
"llama2": {
"modelPath": "./mistral-7b-instruct-v0.2.Q8_0.gguf"
}
},
```
## Important Notes
* AI Warp needs to be rebuilt for any code change to take affect in your test
Expand Down

0 comments on commit ea9b7e6

Please sign in to comment.