Use parameter based num as inference request max output length #10

Merged

FanhaiLu1 merged 1 commit intoAI-Hypercomputer:mainfrom FanhaiLu1:benchmark

Mar 14, 2024

+11-2

Commits on Mar 14, 2024

Set max_output_length by 1024 as default and use max_output_length in inference request
FanhaiLu1
committed