Skip to content

Commit

Permalink
Remove second print of max_batch_weight
Browse files Browse the repository at this point in the history
Signed-off-by: Maximilien de Bayser <[email protected]>
  • Loading branch information
maxdebayser authored Jun 27, 2024
1 parent 01c6ec6 commit cdbcfa7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion router/src/server.rs
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@ impl<'a, B: BatchType> BatchConfigValidator<'a, B> {
.batch_initial_weight(&single_request_stats, 1);
if max_batch_weight < single_request_nexttoken_weight {
panic!(
"The provided max_sequence length ({}) results in a next-token batch weight that exceeds the estimated capacity (max_batch_weight: {})",
"The provided max_sequence length ({}) results in a next-token batch weight that exceeds the estimated capacity ({})",
max_sequence_length, max_batch_weight
)
}
Expand Down

0 comments on commit cdbcfa7

Please sign in to comment.