Add MT-Bench and PR-Bench Support #34
Annotations
10 errors and 10 warnings
|
src/instructlab/eval/gen_api_answer.py#L16
E0401: Unable to import 'common' (import-error)
|
src/instructlab/eval/gen_judgment.py#L11
E0401: Unable to import 'common' (import-error)
|
src/instructlab/eval/common.py#L244
E0606: Possibly using variable 'create_batch' before assignment (possibly-used-before-assignment)
|
src/instructlab/eval/common.py#L434
E1120: No value for argument 'ref_answer' in function call (no-value-for-parameter)
|
src/instructlab/eval/common.py#L437
E1120: No value for argument 'ref_answer' in function call (no-value-for-parameter)
|
src/instructlab/eval/common.py#L538
E0701: Bad except clauses order (OpenAIError is an ancestor class of InvalidRequestError) (bad-except-order)
|
src/instructlab/eval/common.py#L575
E0611: No name 'init_palm_chat' in module 'fastchat.serve.api_provider' (no-name-in-module)
|
|
|
src/instructlab/eval/show_result.py#L9
W0621: Redefining name 'args' from outer scope (line 120) (redefined-outer-name)
|
src/instructlab/eval/show_result.py#L39
W0621: Redefining name 'args' from outer scope (line 120) (redefined-outer-name)
|
src/instructlab/eval/show_result.py#L58
W0612: Unused variable 'index' (unused-variable)
|
src/instructlab/eval/gen_api_answer.py#L30
W1514: Using open without explicitly specifying an encoding (unspecified-encoding)
|
src/instructlab/eval/gen_api_answer.py#L36
W1514: Using open without explicitly specifying an encoding (unspecified-encoding)
|
src/instructlab/eval/gen_api_answer.py#L44
C0121: Comparison '(force_temperature is not None and 'required_temperature' in question.keys()) == False' should be 'force_temperature is not None and 'required_temperature' in question.keys() is False' if checking for the singleton value False, or 'not force_temperature is not None and 'required_temperature' in question.keys()' if testing for falsiness (singleton-comparison)
|
src/instructlab/eval/gen_api_answer.py#L90
W1514: Using open without explicitly specifying an encoding (unspecified-encoding)
|
src/instructlab/eval/gen_api_answer.py#L107
W1309: Using an f-string that does not have any interpolated variables (f-string-without-interpolation)
|
src/instructlab/eval/gen_api_answer.py#L6
W0611: Unused import argparse (unused-import)
|
src/instructlab/eval/gen_judgment.py#L40
C0200: Consider using enumerate instead of iterating with range and len (consider-using-enumerate)
|
This job failed
Loading