Skip to content

v0.3.0

Latest
Compare
Choose a tag to compare
@mtasic85 mtasic85 released this 01 Jan 10:49
· 6 commits to main since this release

Added:

  • Qwen 2 VL 2B / 7B vision models support
  • WIP llama-cpp-cffi server - compatible with llama.cpp cli options instead of OpenAI

Changed:

  • llama.cpp revision 5896c65232c7dc87d78426956b16f63fbf58dcf6
  • Refactored Options class into two separate classes: ModelOptions, CompletionsOptions

Fixed:

  • Llava (moondream2, nanoLLaVA-1.5, llava-v1.6-mistral-7b) vision models support
  • MiniCPM-V 2.5 / 2.6 vision models support

Removed:

  • Removed ambiguous Options class