Skip to content

Commit

Permalink
add explanation of MMLU at the beginning of mt_bench.py
Browse files Browse the repository at this point in the history
It is good practice to include docstrings with clarifications.

Signed-off-by: Costa Shulyupin <[email protected]>
  • Loading branch information
makelinux committed Jul 25, 2024
1 parent 3229ad8 commit dfaa0c2
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions src/instructlab/eval/mt_bench.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,11 @@
# SPDX-License-Identifier: Apache-2.0

"""
Multi-Turn Benchmark
https://klu.ai/glossary/mt-bench-eval
https://arxiv.org/html/2306.05685
"""

# First Party
from instructlab.eval import (
mt_bench_answers,
Expand Down

0 comments on commit dfaa0c2

Please sign in to comment.