Skip to content

Commit

Permalink
minor
Browse files Browse the repository at this point in the history
  • Loading branch information
YannDubs committed Sep 8, 2023
1 parent 35eb0ba commit 7fcf2c3
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -26,10 +26,10 @@ AlpacaEval provides the following:
- [**Human evaluation data**](#data-release): 20K human preferences between a given and reference model
on the [AlpacaFarm](https://github.com/tatsu-lab/alpaca_farm/tree/main)
evaluation set. 2.5K of these are cross-annotations (4 humans annotating the same 650 examples).
- [**AlpacaEval dataset**](#data-release): a simplification
- [**AlpacaEval dataset**](https://huggingface.co/datasets/tatsu-lab/alpaca_eval/blob/main/alpaca_eval.json): a simplification
of [AlpacaFarm's](https://github.com/tatsu-lab/alpaca_farm/tree/main) evaluation set, where "instructions" and "
inputs" are merged
into one field, and reference outputs are longer.
into one field, and reference outputs are longer. [Details here]((#data-release)).

**When to use AlpacaEval?** Our automatic evaluator is a quick and cheap proxy for human evaluation of simple
instruction-following tasks.
Expand Down

0 comments on commit 7fcf2c3

Please sign in to comment.