Skip to content

Commit

Permalink
server : refactor multitask handling (#9274)
Browse files Browse the repository at this point in the history
* server : remove multitask from server_task

* refactor completions handler

* fix embeddings

* use res_ok everywhere

* small change for handle_slots_action

* use unordered_set everywhere

* (try) fix test

* no more "mutable" lambda

* Apply suggestions from code review

Co-authored-by: Georgi Gerganov <[email protected]>

* use deque

---------

Co-authored-by: Georgi Gerganov <[email protected]>
  • Loading branch information
ngxson and ggerganov authored Sep 2, 2024
1 parent b60074f commit 6e7d133
Show file tree
Hide file tree
Showing 5 changed files with 352 additions and 449 deletions.
Loading

0 comments on commit 6e7d133

Please sign in to comment.