Skip to content

0.3.0

Compare
Choose a tag to compare
@b4rtaz b4rtaz released this 22 Apr 20:57
· 131 commits to main since this release
  • New tokenizer format (old tokenizer files are not supported, please regenerate tokenizer files).
  • Added Llama 3 support.
  • Simple-server mode, check this example: nodejs-example.cjs Now you may use Distributed Llama as a simple LLM server.