You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
ggml is an initiative to build small models through quantisation of parameters to smaller datatypes (ggml.ai)
Garak supports an old version of their interface, ggml files + llama.cpp
Things have move forward with ggml. The llama/ggml connector in garak seems to be problematic/broken now, and also, a new gguf file format has emerged.
We should
support gguf
fix or remove the existing ggml file interface
consider having some kind of test for this, depending on the degree of orchestration required
The text was updated successfully, but these errors were encountered:
ggml is an initiative to build small models through quantisation of parameters to smaller datatypes (ggml.ai)
Garak supports an old version of their interface, ggml files + llama.cpp
Things have move forward with ggml. The llama/ggml connector in garak seems to be problematic/broken now, and also, a new gguf file format has emerged.
We should
The text was updated successfully, but these errors were encountered: