Skip to content

0.24.0
Compare
Choose a tag to compare
@matatonic matatonic released this 11 Jun 13:14
· 105 commits to main since this release
0.24.0
55d5930

Recent updates

Version 0.24.0

  • Full streaming support for almost all models.
  • Update vikhyatk/moondream2 to 2024-05-20 + streaming
  • API compatibility improvements, strip extra leading space if present
  • Revert: no more 4bit double quant (slower for insignificant vram savings - protest and it may come back as an option)
Assets 2
Loading