Release gguf-py: server : (UI) add tok/s, get rid of completion.js (#10786) · ggerganov/llama.cpp · GitHub

gguf-py
235f6e1
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Learn about vigilant mode
Compare

Choose a tag to compare

Loading

View all tags

gguf-py: server : (UI) add tok/s, get rid of completion.js (#10786)

gguf-py
235f6e1
Compare

Choose a tag to compare

Loading

View all tags
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Learn about vigilant mode

ngxson tagged this 11 Dec 19:52

* get rid of completion.js

* extract chat bubble to a component

* add tok/s info

* sync

* fix BASE_URL

* only extract timings when it's enabled

* fix auto scroll

Assets 2