Snap package support

[boukendesho]

Hi, 👋
I took a quick look at your snapcraft.yaml.

but it doesn't show the app on the app menu

Desktop app needs a special meta param called 'desktop' , see here
Also you need to specify the Icon file, put it under snap/gui/ directory. File structure will like this:
$ tree .
snap
|

• snapcraft.yaml
• gui
  |
  • your_desktop_file.desktop
  • your_icon.png/svg

For better cli experiences, i suggest you add one more entry under apps in snapcraft.yaml , called ollama, to expose the ollama cli .
After that, you can run it from the terminal, like this $ alpaca.ollama run llama3.1

I'll continue with the rest and if I have time, then will test and submit a PR.

Cheers!

[boukendesho]

Hi, i have one question.

How your program commuicate with ollama, through http request?

Do we need run ollama serve in the background?

[Jeffser]

Yes the app runs the command ollama serve and it communicates using http

[boukendesho]

Just got first runnable snap version !

But there's still a lot of things that need to be perfected.

TODO:

1. Ollama with dGPU test. (i don't have a dGPU )
2. Snap plugs tuning
3. Ollama overrides test.
4. Make a option(such as env parameters) that can let ollama read model files from removable media.
5. Arm64 build support.
6. More tests.

My internet is not so good and very slow to download the models, these are what I can do for now.
Cheers.

[boukendesho]

One more issue, downloaded models through gui didn't show in cli results.
$ alpaca.ollama list show nothing.

I found models are store in ~/snap/alpaca/current/.local/share/com.jeffser.Alpaca/.ollama/, which is not the default path for ollama, may be the key.

[Jeffser]

One more issue, downloaded models through gui didn't show in cli results. $ alpaca.ollama list show nothing.

Yeah it's because of the different directory, I'll see what I can do

[Jeffser]

thanks for your help!