Skip to content

b3655

Compare
Choose a tag to compare
@github-actions github-actions released this 02 Sep 17:13
6e7d133
server : refactor multitask handling (#9274)

* server : remove multitask from server_task

* refactor completions handler

* fix embeddings

* use res_ok everywhere

* small change for handle_slots_action

* use unordered_set everywhere

* (try) fix test

* no more "mutable" lambda

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <[email protected]>

* use deque

---------

Co-authored-by: Georgi Gerganov <[email protected]>