Is there an example of using a model with an OpenAI style? (e.g. LocalAI)?

[shanecowherd]

Does this mean we can use a local app (that matches ChatGPT api) to allow usage without connecting to the internet?

Is there an example of setting this up with something like LlamaCode or Faraday or something?

Awesome!

[intitni]

Yes.

To use LocalAI, you can

1. Clone the repo repo.
2. Download a model and place it into the models folder. EASY MODEL IMPORT - DOWNLOADED
3. Run LocalAI with docker, or build and run it locally.
4. Setup the model

I have only tried building and running locally.

But honestly speaking, it's super slow.