Skip to content

Commit

Permalink
[ENH] add strict decoding OAI (#394)
Browse files Browse the repository at this point in the history
  • Loading branch information
YannDubs authored Aug 18, 2024
1 parent 2990c4d commit 57f29bc
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ alpaca_eval_cot_gpt4_turbo_fn:
function:
name: "make_partial_leaderboard"
description: "Make a leaderboard of models given a list of the models ordered by the preference of their outputs."
strict: true
parameters:
type: "object"
properties:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ alpaca_eval_gpt4_fn:
function:
name: "make_leaderboard"
description: "Make a leaderboard of models given a list of the models ordered by the preference of their outputs."
strict: true
parameters:
type: "object"
properties:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ alpaca_eval_gpt4_turbo_fn:
function:
name: "make_partial_leaderboard"
description: "Make a leaderboard of models given a list of the models ordered by the preference of their outputs."
strict: true
parameters:
type: "object"
properties:
Expand Down
1 change: 1 addition & 0 deletions src/alpaca_eval/evaluators_configs/chatgpt_fn/configs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ chatgpt_fn:
function:
name: "print_best_model"
description: "Print the best model given the preferred output."
strict: true
parameters:
type: "object"
properties:
Expand Down

0 comments on commit 57f29bc

Please sign in to comment.