Skip to content

Commit

Permalink
rm default for return_channel
Browse files Browse the repository at this point in the history
  • Loading branch information
JoeZijunZhou committed Mar 15, 2024
1 parent cf09132 commit fde895e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion jetstream/core/orchestrator.py
Original file line number Diff line number Diff line change
Expand Up @@ -137,7 +137,7 @@ class ActiveRequest:
# We keep prefill and decode information together in the same object so that
# there is less indirection about where this return channel is.
# The return channel returns a list of strings, one per sample for that query.
return_channel: async_multifuture.AsyncMultifuture[list[str]] = None
return_channel: async_multifuture.AsyncMultifuture[list[str]]

def enqueue_tokens(self, generated_tokens: list[str]):
"""Records information about the step.
Expand Down

0 comments on commit fde895e

Please sign in to comment.