Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
ZeldaHuang committed Jan 8, 2025
1 parent 2a605bf commit caadca3
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions llumnix/backends/vllm/scheduler.py
Original file line number Diff line number Diff line change
Expand Up @@ -259,6 +259,7 @@ def schedule(self) -> Tuple[List[SequenceGroupMetadata], SchedulerOutputs, bool]
return seq_group_metadata_list, scheduler_outputs, allow_async_output_proc

def _schedule_running(self, *args, **kwargs):
# pylint: disable=access-member-before-definition
running_queue = self.running
filtered_running_queue = deque()
remove_running = deque()
Expand Down

0 comments on commit caadca3

Please sign in to comment.