Skip to content

Commit

Permalink
Fix incorrect arg validation message
Browse files Browse the repository at this point in the history
  • Loading branch information
njhill committed Mar 27, 2024
1 parent 12eead8 commit 040ac72
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/tgis_utils/args.py
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ def postprocess_tgis_args(args: argparse.Namespace) -> argparse.Namespace:
args.dtype = args.dtype_str
if args.quantize:
if args.quantization and args.quantization != args.quantize:
raise ValueError("Inconsistent dtype and dtype_str arg values")
raise ValueError("Inconsistent quantize and quantization arg values")
args.quantization = args.quantize
if args.num_gpus is not None or args.num_shard is not None:
if args.num_gpus is not None and args.num_shard is not None \
Expand Down

0 comments on commit 040ac72

Please sign in to comment.