Skip to content

Commit

Permalink
Set use 1 shot for wikitq in tables_benchmark
Browse files Browse the repository at this point in the history
Signed-off-by: Yifan Mai <[email protected]>
  • Loading branch information
yifanmai committed Jan 21, 2025
1 parent 2824ae0 commit fb502e7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion prepare/recipes/tables_benchmark.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@
serializers = ",".join(list(SERIALIZERS))
max_augmentors = 10
max_pred_tokens = 100
num_demos = 5
recipes_only = False

# Process parameters
Expand All @@ -35,6 +34,7 @@
for card in cards_parsed:
for augment in all_augment:
for serializer in serializers_parsed:
num_demos = 1 if card == "wikitq" else 5
kwargs = {
"card": "cards." + card,
"serializer": f"serializers.table.{serializer}"
Expand Down

0 comments on commit fb502e7

Please sign in to comment.